Hyperband: training for a longer time

Hyperband's rule of thumb works great when I want to sample more parameters than training epochs:
>>> X, y = make_classification(n_samples=1000)
>>> n_params = 200
>>> n_examples = len(X) * 200
>>> max_iter = n_params
>>> chunksize = n_examples // n_params
>>> chunksize
1000

This indicates the model should see the entire dataset every partial_fit call:
>>> from dask_ml.model_selection import HyperbandSearchCV
>>> search = HyperbandSearchCV(model, params, max_iter=200)
>>> search.metadata["n_models"]
143

How do I train for longer while still sampling (about) 200 parameters? The rule of thumb won't work because it specifies a chunk size larger than the array. Right now, the only way is to sample more parameters:
>>> from dask_ml.model_selection import HyperbandSearchCV
>>> search = HyperbandSearchCV(model, params, max_iter=400)  # to train for no more than 400 epochs
>>> search.metadata["n_models"]
415

That's more hyperparameters than I need to sample.

This could be fixed by adding a chunk_per_iter parameter:
>>> from dask_ml.model_selection import HyperbandSearchCV
>>> search = HyperbandSearchCV(model, params, max_iter=200, chunks_per_iter=2)
>>> search.metadata["n_models"]
143

Then, each partial_fit call would train on data_per_iter examples. It'd do the equivalent of this:
def _partial_fit(model, X, y):
    n_examples = 0
    while True:
        model.partial_fit(X, y)
        n_examples += len(y)
        if n_examples >= chunk_per_iter * len(X):
            break
    return model

@TomAugspurger do you have any other solutions?

Sorry, I'm not sure I understand the issue or the proposed solution.
You're saying that there's some relationship between the chunksize (not the number of chunks?), the user-providedmax-iter and the number of models trained metadata["n_models"]. And the proposed solution is to merge some chunks during training?

between the chunksize (not the number of chunks?), the user-providedmax-iter and the number of models trained metadata["n_models"]

Almost. There's a relation between the max_iter and metadata["n_models"]. Increasing max_iter also increases metadata["n_models"]. The issue: why can't the user train for longer by increasing max_iter without increasing metadata["n_models"]?
The cleanest solution is to add a n_params or n_iter attributed to HyperbandSearchCV. Then, if specified metadata["n_models"] == n_params. That will require some more thought.


Does not work with yarn workspaces

Describe the bug
When using in a project that is a yarn workspace (on a monorepo setup), the plugin fails to find modules because of node_modules being hoisted up to the root folder:
yarn storybook
yarn run v1.22.17
$ start-storybook -p 6006 -s public
info @storybook/react v6.4.18
info
(node:61699) DeprecationWarning: --static-dir CLI flag is deprecated, see:

https://github.com/storybookjs/storybook/blob/next/MIGRATION.md#deprecated---static-dir-cli-flag
(Use `node --trace-deprecation ...` to show where the warning was created)
info => Loading presets
info => Serving static files from ./public at /
info => Using implicit CSS loaders
ERR! Error: Cannot find module '<project-root>/storybook-addon-next/examples/with-tailwindcss/node_modules/next/package.json'
ERR! Require stack:
ERR! - <project-root>/storybook-addon-next/examples/node_modules/storybook-addon-next/dist/utils.js
ERR! - <project-root>/storybook-addon-next/examples/node_modules/storybook-addon-next/dist/preset.js
ERR! -<EMAIL_ADDRESS>ERR! -<EMAIL_ADDRESS>ERR! -<EMAIL_ADDRESS>ERR! -<EMAIL_ADDRESS>ERR! -<EMAIL_ADDRESS>ERR! -<EMAIL_ADDRESS>ERR! -<EMAIL_ADDRESS>ERR!     at Function.Module._resolveFilename (node:internal/modules/cjs/loader:933:15)
ERR!     at Function.Module._load (node:internal/modules/cjs/loader:778:27)
ERR!     at Module.require (node:internal/modules/cjs/loader:1005:19)
ERR!     at require (node:internal/modules/cjs/helpers:102:18)
ERR!     at getNextjsVersion (<project-root>/storybook-addon-next/examples/node_modules/storybook-addon-next/dist/utils.js:9:1)
ERR!     at configureStaticImageImport (<project-root>/storybook-addon-next/examples/node_modules/storybook-addon-next/dist/images/webpack.js:14:50)
ERR!     at configureImages (<project-root>/storybook-addon-next/examples/node_modules/storybook-addon-next/dist/images/webpack.js:8:5)
ERR!     at <project-root>/storybook-addon-next/examples/node_modules/storybook-addon-next/dist/preset.js:29:35
ERR!     at Generator.next (<anonymous>)
ERR!     at fulfilled (<project-root>/storybook-addon-next/examples/node_modules/tslib/tslib.js:114:62)
ERR!  Error: Cannot find module '<project-root>/storybook-addon-next/examples/with-tailwindcss/node_modules/next/package.json'
ERR! Require stack:
ERR! - <project-root>/storybook-addon-next/examples/node_modules/storybook-addon-next/dist/utils.js
ERR! - <project-root>/storybook-addon-next/examples/node_modules/storybook-addon-next/dist/preset.js
ERR! -<EMAIL_ADDRESS>ERR! -<EMAIL_ADDRESS>ERR! -<EMAIL_ADDRESS>ERR! -<EMAIL_ADDRESS>ERR! -<EMAIL_ADDRESS>ERR! -<EMAIL_ADDRESS>ERR! -<EMAIL_ADDRESS>ERR!     at Function.Module._resolveFilename (node:internal/modules/cjs/loader:933:15)
ERR!     at Function.Module._load (node:internal/modules/cjs/loader:778:27)
ERR!     at Module.require (node:internal/modules/cjs/loader:1005:19)
ERR!     at require (node:internal/modules/cjs/helpers:102:18)
ERR!     at getNextjsVersion (<project-root>/storybook-addon-next/examples/node_modules/storybook-addon-next/dist/utils.js:9:1)
ERR!     at configureStaticImageImport (<project-root>/storybook-addon-next/examples/node_modules/storybook-addon-next/dist/images/webpack.js:14:50)
ERR!     at configureImages (<project-root>/storybook-addon-next/examples/node_modules/storybook-addon-next/dist/images/webpack.js:8:5)
ERR!     at <project-root>/storybook-addon-next/examples/node_modules/storybook-addon-next/dist/preset.js:29:35
ERR!     at Generator.next (<anonymous>)
ERR!     at fulfilled (<project-root>/storybook-addon-next/examples/node_modules/tslib/tslib.js:114:62) {
ERR!   code: 'MODULE_NOT_FOUND',
ERR!   requireStack: [
ERR!     '<project-root>/storybook-addon-next/examples/node_modules/storybook-addon-next/dist/utils.js',
ERR!     '<project-root>/storybook-addon-next/examples/node_modules/storybook-addon-next/dist/preset.js',
ERR<EMAIL_ADDRESS>ERR<EMAIL_ADDRESS>ERR<EMAIL_ADDRESS>ERR<EMAIL_ADDRESS>ERR<EMAIL_ADDRESS>ERR<EMAIL_ADDRESS>ERR<EMAIL_ADDRESS>ERR!   ]
ERR! }

WARN Broken build, fix the error above.
WARN You may need to refresh the browser.

error Command failed with exit code 1.
info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.

Your minimal, reproducible example
https://github.com/volkyeth/storybook-addon-next/tree/broken-with-yarn-workspaces
Steps to reproduce
git clone --branch broken-with-yarn-workspaces git@github.com:volkyeth/storybook-addon-next.git
cd storybook-addon-next/examples
yarn install
cd with-tailwindcss
yarn storybook

Expected behavior
Package should work with yarn workspaces
How often does this bug happen?
Every time
Screenshots or Videos
No response
Platform
OS: MacOS
storybook-addon-next version
1.4.2
Additional context
I'm not sure what's the fix for this as I'm not very experienced at packaging libs. I'll try to look into it but if someone knows how to make it compatible please advise and I'll try to make a PR

btw, the workaround for this is using the nohoist option on the root package.json like so:
{
    "private": true,
    "workspaces": {
        "packages": [
            "with-tailwindcss"
        ],
        "nohoist": [
            "**/storybook-addon-next",
            "**/storybook-addon-next/**"
        ]
    }
}

this way the node_modules with dependencies of storybook-addon-next is kept on the folder of the package using it, so it can find the dependencies

Thanks for opening up this issue!
Here you mentioned that storybook dependencies don't work well for yarn workspaces either. Could you clarify? Also if that is the case, is this problem worth fixing in this repo if storybook can't be used with it?

Yeah, I'd agree. How are package resolutions supposed to work in mono repos like that?

Imagine the following folder structure:
/packages
  /my-storybook
    /.storybook
    /stories
    /package.json
  /ui-library
    /Button.jsx
    /package.json
/node_modules
/package.json
/package-lock.json

If you run npm install npm/yarn will go through your packages' package.json file and install all their dependencies withing the root's /node_modules folder and link them together. So there only is one node_modules folder and one package-lock.json file.
In this example the workspace "my-storybook" imports the ui-library workspace and displays it within storybook.
This setup is very usefull for bigger projects, as you can exclude certain packages (and their dependencies) when deploying and so speed up your pipelines. Also it makes your project nicely structured and understandable...

@RyanClementsHax what makes packages incompatible with workspaces is missing some dependency declarations or explicitly referencing the node_modules folder, as yarn workspaces hoists the subprojects node_modules folders up to the monorepo folder, and the newer yarn pnp does not even have a node_modules, so any dependency on the regular folder structure breaks the packages.
over here I think using require.resolve fixes the issue
I'm not sure how to solve it in .czrc and .husky though

Fixed in #26

The previous errors are gone! 🥳
There are some new ones (see error below).
I am trying to get the basic example from next/examples running within my project.
npm run storybook

><EMAIL_ADDRESS>storybook
> turbo run storybook

• Packages in scope: config, e2e, generated, storybook, tsconfig, ui, web
• Running storybook in 7 packages
storybook: cache miss, executing 7e6fa4dd60a59a63
storybook:
storybook: > storybook
storybook: > start-storybook -p 6006
storybook:
storybook: info @storybook/react v6.4.19
storybook: info
storybook: info => Loading presets
storybook: info => Using implicit CSS loaders
storybook: info => Using default Webpack5 setup
storybook: <s> [webpack.Progress] 0%
storybook:
storybook: <s> [webpack.Progress] 1% setup initialize
storybook: [...]
storybook: <s> [webpack.Progress] 100%
storybook:
storybook: ModuleBuildError: Module build failed (from ../../node_modules/css-loader/dist/cjs.js):
storybook: ValidationError: Invalid options object. CSS Loader has been initialized using an options object that does not match the API schema.
storybook:  - options.url should be one of these:
storybook:    boolean | object { filter? }
storybook:    -> Allows to enables/disables `url()`/`image-set()` functions handling.
storybook:    -> Read more at https://github.com/webpack-contrib/css-loader#url
storybook:    Details:
storybook:     * options.url should be a boolean.
storybook:     * options.url should be an object:
storybook:       object { filter? }
storybook:  - options.import should be one of these:
storybook:    boolean | object { filter? }
storybook:    -> Allows to enables/disables `@import` at-rules handling.
storybook:    -> Read more at https://github.com/webpack-contrib/css-loader#import
storybook:    Details:
storybook:     * options.import should be a boolean.
storybook:     * options.import should be an object:
storybook:       object { filter? }
storybook:     at validate (/code/webapp/node_modules/schema-utils/dist/validate.js:105:11)
storybook:     at Object.getOptions (/code/webapp/node_modules/webpack/lib/NormalModule.js:580:19)
storybook:     at Object.loader (/code/webapp/node_modules/css-loader/dist/index.js:31:27)
storybook:     at processResult (/code/webapp/node_modules/webpack/lib/NormalModule.js:753:19)
storybook:     at /code/webapp/node_modules/webpack/lib/NormalModule.js:855:5
storybook:     at /code/webapp/node_modules/loader-runner/lib/LoaderRunner.js:399:11
storybook:     at /code/webapp/node_modules/loader-runner/lib/LoaderRunner.js:251:18
storybook: ModuleBuildError: Module build failed (from ../../node_modules/css-loader/dist/cjs.js):
storybook: ValidationError: Invalid options object. CSS Loader has been initialized using an options object that does not match the API schema.
storybook:  - options.url should be one of these:
storybook:    boolean | object { filter? }
storybook:    -> Allows to enables/disables `url()`/`image-set()` functions handling.
storybook:    -> Read more at https://github.com/webpack-contrib/css-loader#url
storybook:    Details:
storybook:     * options.url should be a boolean.
storybook:     * options.url should be an object:
storybook:       object { filter? }
storybook:  - options.import should be one of these:
storybook:    boolean | object { filter? }
storybook:    -> Allows to enables/disables `@import` at-rules handling.
storybook:    -> Read more at https://github.com/webpack-contrib/css-loader#import
storybook:    Details:
storybook:     * options.import should be a boolean.
storybook:     * options.import should be an object:
storybook:       object { filter? }
storybook:     at validate (/code/webapp/node_modules/schema-utils/dist/validate.js:105:11)
storybook:     at Object.getOptions (/code/webapp/node_modules/webpack/lib/NormalModule.js:580:19)
storybook:     at Object.loader (/code/webapp/node_modules/css-loader/dist/index.js:31:27)
storybook:     at processResult (/code/webapp/node_modules/webpack/lib/NormalModule.js:753:19)
storybook:     at /code/webapp/node_modules/webpack/lib/NormalModule.js:855:5
storybook:     at /code/webapp/node_modules/loader-runner/lib/LoaderRunner.js:399:11
storybook:     at /code/webapp/node_modules/loader-runner/lib/LoaderRunner.js:251:18
storybook:
storybook:
storybook: WARN Broken build, fix the error above.
storybook: WARN You may need to refresh the browser.
storybook: Error: command finished with error: exit status 1

It seems like css-loader is initialized with the wrong config?
Here are the versions of css-loader that are installed:
npm ls css-loader

<EMAIL_ADDRESS>└─┬ storybook@ -> ./apps/storybook
  ├─┬<EMAIL_ADDRESS>  │ └─┬<EMAIL_ADDRESS>  │   └─┬<EMAIL_ADDRESS>  │     └──<EMAIL_ADDRESS>  ├─┬<EMAIL_ADDRESS>  │ └──<EMAIL_ADDRESS>  ├─┬<EMAIL_ADDRESS>  │ └──<EMAIL_ADDRESS>  ├─┬<EMAIL_ADDRESS>  │ └─┬<EMAIL_ADDRESS>  │   └─┬<EMAIL_ADDRESS>  │     └─┬<EMAIL_ADDRESS>  │       └──<EMAIL_ADDRESS>  └─┬<EMAIL_ADDRESS>    └──<EMAIL_ADDRESS>

CSS Loader has been initialized using an options object that does not match the API schema.

This is #22
Are you using nohoist on your workspace? This issue only manifested for me with nohoist because then storybook-addon-next managed to pick its own css-loader version and broke because of selecting the wrong one

@volkyeth
I am not using nohoist. All my dependencies are hoisted to the root folder.
From issue #22 it sounds like css-loader >6.0.0 is the issue. storybook-addon-next is still depending on it.
I downgraded to<EMAIL_ADDRESS>and it works now! Thanks for the tips.

@volkyeth so it turns out that the fix made in #26 breaks local development (yarn watch) because require.resolve('styled-jsx') tries to resolve to the root node modules folder instead of the examples one. Do you know of a way to preserve support for monorepos while also allowing for local development?

@RyanClementsHax yeah, that's an issue with Yarn v1 link. It's solved on Yarn v2+
Refs:
https://twitter.com/arcanis/status/1133706355888590849?s=20&t=be7t-pmMkf9EuKzd11kUPw
https://yarnpkg.com/features/protocols#whats-the-difference-between-link-and-portal
I'm trying to upgrade it so we switch from link: to portal: protocol on the examples, then I'll send a PR. Would that work for you?
In my experience, it's worth using Yarn v2+. I've been hitting so many issues with yarn that won't be fixed in v1, so I guess it's time to move on. Performance of yarn install on v2+ is also great.

Interesting that it solved those problems for you. I've had a terrible time trying to get yarn link to work in v2+. I'd be happy to see what u come up with.
I do have one concern with yarn v2+ that I was hoping you could help answer. Why does it seem no one uses yarn v2+? It seems like everyone still uses v1.

I do have one concern with yarn v2+ that I was hoping you could help answer. Why does it seem no one uses yarn v2+? It seems like everyone still uses v1.

Yarn v2 adds a runtime dependency to make the PnP magic mode work, essentially hiding the node_module folder from the tools that analyze the code statically.
In other words, the development tooling has to support Yarn PnP to work correctly.
We switched to pnpm because it produces the node_modules folder with the efficiency of Yarn v2 using a unix-standard symlink/copy strategy, and it's even faster than Yarn.
For example, it takes Yarn v1 over 3 minutes to do a clean install for one of my projects with Storybook. It takes just 40 seconds with pnpm.

I was able to find a way to get package resolution working with #31. That being done, I'm still interested in any ideas to improve package management within this repo.
Also ty @illarionvk for the explanation.

@daviddelusenet I created a pull request (#40) that adds this feature. I'm just looking for an example repo to make sure I solved it properly. Are you able to provide one?

Hi @RyanClementsHax! Awesome plugin! I've checked in with @daviddelusenet offline and I can setup a quick example repo (using NPM workspaces; I've never used yarn workspaces, though I imagine the setup is very similar) early next week :) Or if you prefer, I can also test it myself next week.

@thijsdaniels Thanks! I really appreciate the complements!
Someone helped out a bunch by contributing an example that uses nx (#41) which allowed me to publish a version of this repo that allows a developer to specify a path for the next config (see options).
Hopefully this works for you. Let me know if it doesn't.
That being said, I'd still be open to receive any examples you're willing to contribute.

@RyanClementsHax Sorry for disappearing for a while! Just tested with our NPM workspaces setup and it works like a charm :)

No problem! It happens. I'm glad it worked out for you


limit ensuerCartridgeExists to prod environments

Check to see if the script is in the dev environment before running ensuerCartridgeExists method

This isn't needed, i missed the way that it was done in the base module

This isn't needed, i missed the way that it was done in the base module


Forked

Hi, I forked it here: https://github.com/rochacbruno/flasgger
Added a demo app http://flasgger-rochacbruno.rhcloud.com/
As ai changed many things, included SwaggerUI embedded to the extension, changed from function to class based and blueprint based views.
So I did not sent a pull request yet.
Are you interested in merge? (we can keep backwards compatibility) or simply mention each extension on READMEs.
Thanks for the work!
Open Source Rocks!

Hi Bruno, thanks for this! I'll definitely have a look and think about this.
Not a huge fan of embedding SwaggerUI seeing how it's a fast-moving target itself and I don't want flask-swagger to get in people's way with that (it's also one of the reasons I wrote flask-swagger instead of using flask-restful-swagger)


Chapter 12 and Chapter 14 Examples

Description:
Chapter 12: Example models for custom layers.

Added an example model code snippets for MyMultiLayer and AddGaussianNoise custom layers.
For MyMultiLayer custom layer model code, please review the cell blocks from 144 to 151.
For AddGaussianNoise custom layer mode code, please review the cell blocks from 153 to 155.

Chapter 14: Example for Convolution Layer

Added an example for sample images Keras convolution layer, Please refer to cell blocks 8 to 10

Hi Sundeep,
Thanks for your PR. Adding examples in Chapter 12 is a good idea, and thanks for catching the typo in Chapter 14 (I wrote crop() instead of conv().
However, I try to keep each PR focused on one change at a time, and I also try to restrict the PR to the modified cells. Could you please split this PR into 2 or 3 (for MyMultiLayer, AddGaussianNoise and the Convolutional Layer), and restrict the changes to the modified cells (i.e., the outputs of the other cells should not be modified).
I can do it if you prefer.
Thanks again!
Aurélien

Thanks @ageron  for the review comments. I'll raise the new PR's for each change. Closing this PR.


Code Highlighting does not work

I have seen that code highlighting does not work. If you create a new slide:
yo reveal:slide "Example Slide"

and then you put this in the slide as a test:

var a = 34
var b = function(){
return "great"
}

System.out.println("What is this?");
String p = "this is p";

You' ll see the code won't be highlighted.
I believe the reason for this is that the code will be highlighted only if already present from the start in the DOM of index.htm. However, as the html slides are loaded one by one and not present in the DOM, the code won't be highlighted.

Hi @rezpe,
thank you for the detailed description. You are right. You need to remove the condition
condition: function() { return !!document.querySelector( 'pre code' ); }

from line 77 of your generated templates/_index.html file.
I will update this to a more sane default so highlighting works out of the box.

Thanks Jan !! Let us know when to update the generator to have this :)
On Mon, Jul 13, 2015 at 9:53 AM Jan Raasch<EMAIL_ADDRESS>wrote:

Hi @rezpe https://github.com/rezpe,
thank you for the detailed description. You are right. You need to remove
the condition
condition: function() { return !!document.querySelector( 'pre code' ); }
from line 77 of your generated templates/_index.html file.
I will update this to a more sane default so highlighting works out of the
box.
—
Reply to this email directly or view it on GitHub
https://github.com/slara/generator-reveal/issues/69#issuecomment-120841622
.

As I said, you may simply update your locally generated templates/_index.html. Plus, the fix is now live with v0.5.2.


ENH: Finalize ITKv5 const function API change

Required after InsightSoftwareConsortium/ITK@58e84617ff36c78167706727f1df44a376adb522

Failing packaging is handled by a separate PR #601


Add CO-RE version of capabilities

Hi.
In this PR, I added CO-RE version of capabilities.
The eBPF code was taken from iovisor/bcc#3890.
This fixes #592.
Best regards.

Thank you for the review!


[CAMEL-15881] Rebalancing cluster service

This adds a general purpose rebalancing cluster service. It needs a delegate PreemptiveCamelClusterService, for which I've added an implementation in Camel-Kubernetes.
In Camel-Kubernetes, this also adds the possibility to use "coordination.k8s.io" Leases as lock resources (default). ConfigMap based locking is still supported.

[x] Make sure there is a JIRA issue filed for the change (usually before you start working on it).  Trivial changes like typos do not require a JIRA issue.  Your pull request should address just this issue, without pulling in other changes.
[x] Each commit in the pull request should have a meaningful subject line and body.
[x] If you're unsure, you can format the pull request title like [CAMEL-XXX] Fixes bug in camel-file component, where you replace CAMEL-XXX with the appropriate JIRA issue.
[x] Write a pull request description that is detailed enough to understand what the pull request does, how, and why.
[x] Run mvn clean install -Psourcecheck in your module with source check enabled to make sure basic checks pass and there are no checkstyle violations. A more thorough check will be performed on your pull request automatically.
Below are the contribution guidelines:
https://github.com/apache/camel/blob/master/CONTRIBUTING.md

There is a CS error in camel-kubernetes


Fix list rendering in RFENCE Extension

Without an empty line, the two items are not rendered as a list but put inline with the previous line.

Thanks for the fixes. You can send all the commits as a single PR as well :)


StopIteration: generator_output = next(output_generator)

Hi,  I have followed this tutorial step by step for skin segmentation task, but when I execute model.train() , I get the error mentioned in title.
I am using tensorflow 1.15 and keras 2.0.8

Same here.
CODE:
start_train = time.time()
model.train(train_data, test_data,
            learning_rate=config.LEARNING_RATE,
            epochs=5,
            layers='heads')
end_train = time.time()
minutes = round((end_train - start_train) / 60, 2)
print(f'Training took {minutes} minutes')

ERROR:
StopIteration                             Traceback (most recent call last)
<ipython-input-23-1abede8f6975> in <module>
      3             learning_rate=config.LEARNING_RATE,
      4             epochs=5,
----> 5             layers='heads')
      6 end_train = time.time()
      7 minutes = round((end_train - start_train) / 60, 2)

/kaggle/working/Mask_RCNN/mrcnn/model.py in train(self, train_dataset, val_dataset, learning_rate, epochs, layers, augmentation, custom_callbacks, no_augmentation_sources)
   2372             max_queue_size=100,
   2373             workers=workers,
-> 2374             use_multiprocessing=True,
   2375         )
   2376         self.epoch = max(self.epoch, epochs)

/opt/conda/lib/python3.6/site-packages/keras/legacy/interfaces.py in wrapper(*args, **kwargs)
     85                 warnings.warn('Update your `' + object_name +
     86                               '` call to the Keras 2 API: ' + signature, stacklevel=2)
---> 87             return func(*args, **kwargs)
     88         wrapper._original_function = func
     89         return wrapper

/opt/conda/lib/python3.6/site-packages/keras/engine/training.py in fit_generator(self, generator, steps_per_epoch, epochs, verbose, callbacks, validation_data, validation_steps, class_weight, max_queue_size, workers, use_multiprocessing, shuffle, initial_epoch)
   2009                 batch_index = 0
   2010                 while steps_done < steps_per_epoch:
-> 2011                     generator_output = next(output_generator)
   2012
   2013                     if not hasattr(generator_output, '__len__'):

StopIteration: ```


FN - drainers

Hi there,
I have been looking at recent scams during January.
Takeaway here is that the scam detector is not good enough at detecting permit/increase allowance cases. I believe this should be covered with ICE-PHISHING-ZERO-NONCE-ALLOWANCE-TRANSFER and ICE-PHISHING-ZERO-NONCE-ALLOWANCE.
Some examples:
1

tx here
Permitted address https://etherscan.io/address/0xb4f1e54aa92faca4d7fd67cbf770c8d261dd169e

2
-tx here
-allowed address https://etherscan.io/address/0xacf24003394607e982a7a3867fdd502be942e621

I'm seeing that we've got a
ZERO-NONCE-ALLOWANCE-TRANSFER for the first
and a NIP-9 for both 1 and 2
Need to investigate why SD didn't trigger (perhaps due to the nonce?)

Fixed in v2.24.0

Hi vasilis,
I have recently seen this which maybe an edge case.
In this opportunity the spender seems to be a msig , are we covering that? I haven't seen an ice phishing alert flagging the mentioned msig.

I've created a new alert ICE-PHISHING-MULTISIG, which I'm currently testing. I'll let you know if the precision is good enough.

@Ivan1905, I've created a new alert ICE-PHISHING-MULTISIG, which I'm currently testing. I'll let you know if the precision is good enough.


How to change Label size?

How to change Label size?

You can try passing customCSS="div#root h3 { font-size: 12px }",


Added a first fortran example to prove the tool works for fortran code

Added a first fortran example to prove it works.
Notably its a bit of a pain to compile with flang since by default it wants to use gfortran  to actually compile, which by default will use libgomp and thus not work.
In the Makefile it then needs -L/path/to/llvm/lib setting in the LDFLAGS and then these are used to link to -lomp which means the llvm openMP is used.
I tested the example and it gives me the same output as the C version.

Hi Aidan,
Thank you very much for your contribution, I'll be happy to include it! For now, as Otter is a work-in-progress for my MSc, I want to keep separate my original work from any contributions to ensure I do not submit your contributions as my own. Are you happy for me to merge your PR into a separate branch for now, to be merged into main once I have submitted?

I have created the contributions branch for this purpose.

Sure thing, I'll update this PR to merge to that branch - probably we can hold this PR off as I'll probably put together a few more of the examples to check it works for other parts as well.


Create a display page (frontend) to SSO (Old 27)

In gitlab by @A-Lawrence on Aug 31, 2015, 01:10
Instead of a nasty error, display a "window" to SSO for users that have logged in.

In gitlab by @A-Lawrence on Aug 31, 2015, 01:18
Removing milestone: RELEASE :: 1.0.7 (automated comment)
ALawrence66 - 2013-09-29T01:14:05.530970+00:00

In gitlab by @A-Lawrence on Aug 31, 2015, 01:18
Final display modifications.  Re issue #488654 (27) and #26
ÔåÆ <<cset 65b6104aabc5>>
ALawrence66 - 2013-07-31T01:36:17.738868+00:00

In gitlab by @A-Lawrence on Aug 31, 2015, 01:18
Created the frontend for the display page, for SSO front.  Resolves #488654 (27).
Added the admin ability to override an account - resolves issue #26.
ÔåÆ <<cset 1d818d2211b1>>
ALawrence66 - 2013-07-31T01:36:17.467571+00:00

In gitlab by @A-Lawrence on Aug 31, 2015, 01:18
Changed the default route to be display.php for the SSO frontend.
Resolves issue #488654 (27)
ÔåÆ <<cset 31b254e4d0d4>>
ALawrence66 - 2013-07-31T01:36:17.423521+00:00

In gitlab by @A-Lawrence on Aug 31, 2015, 01:18
Added the ability to display account data - resolves issue #488654 (27).
Reflection qualification modifications - resolves issue #28.  Added the
action/process for account override - resolves issue #488655 (26).
ÔåÆ <>
ALawrence66 - 2013-07-31T01:36:17.270532+00:00


After any print, the printer becomes unresponsive

In my Python application, my printer Excelvan HOP-E58 (and other models) becomes unresponsive for about 3-5 seconds after printing something.
In other words, after the print is done, if I try to print something else, I need to wait for those 3-5 seconds before being able to reprint again.
I tried with the following and in both cases, the printer becomes unresponsive afterward.
os.system("lpr -o job-priority=100 -o fit-to-page -o orientation-requested=3 -o media=Custom.58x210mm logo.png")
os.system("lpr -o job-priority=100 -o fit-to-page -o orientation-requested=3 -o media=Custom.58x210mm output.txt")
Is this a normal behavior or is this a bug?
If this is indeed a bug, is there a way to fix it or is there a temporary workaround?
I love these drivers but at the same time, I really need to be able to print my reports right away without me waiting for the printer to become available again (3-5 seconds) between each print.
To reproduce the issue, just print anything and after the print is done, reprint something again right away.

May be a bug.
I am not yet right now looking at the code, but I remember that in one of the issues smbdy mentioned some small fixes. See #5 for example.

The driver that you suggested me to try, is actually much worse. Beside not fixing the unresponsiveness of the printer, it also prints jibberish when I execute the following command.
os.system("lpr -o job-priority=100 -o fit-to-page -o orientation-requested=3 -o media=Custom.58x210mm output.txt")
Please let me know if there are any updates regarding this issue.

I have changes something, but since I've never hit with your problem, I don't know if it helps or not.
However you may try.
(and note, not just filter, but also PPD changed, so need to reinstall both!)


python310Packages.watchdog: 2.2.0 -> 2.2.1

Changelog: https://github.com/gorakhargosh/watchdog/blob/v2.2.1/changelog.rst
Description of changes

Things done

Built on platform(s)

[ ] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.05 Release Notes (or backporting 22.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module
[ ] (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes

[ ] Fits CONTRIBUTING.md.

Needs go to staging...

@ofborg build python310Packages.watchdog python311Packages.watchdog python311Packages.mkdocs python311Packages.werkzeug


Verify SSL certificate or disable certificate verification

InsecureRequestWarnings are annoying and they probably have a point. CDSTAR connections via HTTPS should either verify the certificate that is being used (import certifi ... cert_reqs='CERT_REQUIRED' & ca_certs=certifi.where()) or disable warnings (doesn't seem like the best idea -- urllib3.disable_warnings()).

Noticing this just now:
https://github.com/clld/pycdstar/blob/b445f159a5f31e804440800a8a4983101919d386/src/pycdstar/api.py#L58-L59
Is there any reason why the verification is set to false? With true, requests and urllib3 are happy and make (as far as I can tell) perfectly validated SSL requests.

Good call. This could date back to a time, where the root cert used by GWDG wasn't always in the distros.


Fixed to use batch update

Codecov Report

Merging #314 into master will decrease coverage by 19.26%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #314       +/-   ##
==========================================
- Coverage    21.7%   2.43%   -19.27%
==========================================
  Files          71      52       -19
  Lines        1963    1314      -649
  Branches      286     180      -106
==========================================
- Hits          426      32      -394
+ Misses       1449    1281      -168
+ Partials       88       1       -87

Impacted Files
Coverage Δ

atcoder-problems-backend/src/sql/streak.rs

atcoder-problems-backend/src/sql/models.rs

...tcoder-problems-backend/src/sql/rated_point_sum.rs

...er-problems-backend/src/lambda/time_submissions.rs

atcoder-problems-backend/src/lambda/io.rs

atcoder-problems-backend/src/crawler.rs

...tcoder-problems-backend/src/sql/contest_problem.rs

atcoder-problems-backend/src/sql.rs

atcoder-problems-backend/src/sql/simple_client.rs

atcoder-problems-backend/src/s3.rs

... and 8 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 72c7d45...8d72a26. Read the comment docs.


examples: Fix docker-compose mount points

Add /var/run/netns which is needed for named netns of cilium-health ep.
Document netns related mounts.
Remove unnecessary /run/docker/plugins mount from cilium-agent container, as cilium agent does not need to access any plugin socket.

NOTE: we use rshared mount propagation for netns related mounts to prevent from possibly leaking netns. See for more details: https://github.com/moby/moby/issues/32090.

This change is

@brb was the getting-started GSG for Docker Compose broken because of this? Or was it only broken for the IPVLAN case?

It wasn't broken, just cilium-health's named netns couldn't be seen from the host (minor thing).

Coverage increased (+0.08%) to 43.006% when pulling 48b671efb6ab9f75eef966f1b75039b82d46dfca on pr/brb/docker-compose-mounts into 6f9922f846037113d108c77c4e654ba42c98aa5d on master.


docs:add english pull private image in sealos cloud docs

Signed-off-by: 晓杰<EMAIL_ADDRESS>

Can add private image using hub.sealos.cn doc in the near future.


Warning! Detected 437.83 seconds time difference between your browser and the server. Prometheus relies on accurate time and time drift might cause unexpected query results.

What did you do?
PossibleSolution
Prometheus synchronizes time with grafana to maintain the same time
What did you expect to see?
No response
What did you see instead? Under which circumstances?
CurrentBehavior
In Prometheus web there is a 5min difference with Grafana
System information
No response
Prometheus version
No response
Prometheus configuration file
No response
Alertmanager version
No response
Alertmanager configuration file
No response
Logs
No response

Check if there is a time gap between your server and browser

This doesn't seem to be a bug report or feature request. I'll convert it into a discussion.


Seq2Seq model training with DPO

Hello,
I was looking at the DPO implementation to train T5 on a summarization task. It looks like both the DPOCollator and the DPOTrainer won't work for encoder-decoder architectures. Is it on purpose? Does DPO not work well for seq2seq models (I didn't find any experiments with T5 in their paper)?
If it is relevant I can try to work on an implementation that supports seq2seq models (it won't require that much changes from what I have seen).

Great point!
Quickly looking at the DPOTrainer source code I don't think there is anything blocking for enc-dec models. I did not tested or tried anything though. Perhaps you can try to adapt the script: https://github.com/lvwerra/trl/blob/main/examples/dpo.py to a T5-like model and see if you face into any issue ! If it does not work out of the box then we'll need to think of how to adapt the trainer for seq2seq models
Maybe @kashif, @TevenLeScao & @tomaarsen can also share their thoughts as I am not 100% familiar with DPO
Thanks !

Hello!
I've also not experimented with any models other than ones that are loaded with AutoModelForCausalLM - I've only tested with GPT2 and some other tiny models.
Did you get this error?
  File "[path]\transformers\models\t5\modeling_t5.py", line 987, in forward
    raise ValueError(f"You have to specify either {err_msg_prefix}input_ids or {err_msg_prefix}inputs_embeds")
ValueError: You have to specify either decoder_input_ids or decoder_inputs_embeds

Tom Aarsen

Hello @tomaarsen @younesbelkada, T5 like models require labels in order to do teacher forcing + the prompt and the chosen/rejected responses should not be concatenated together. This is the case in the current DPO implementation. I have worked on something yesterday. I will make a pull request if that's okay for you.

Hi @gaetanlop @tomaarsen
Thanks for all your replies,
That sounds great, looking forward to your PR !

@gaetanlop thanks for this... yes currently we only tested with decoder only models and thus things were contacted together to avoid multiple forward calls... but you are right in the enc-dec setting those helpers would need to be extended appropriately... I do not think there is inherently anything in DPO stopping the use of enc-dec models so your PR will be a useful extension!

Thanks for the confirmation @kashif!

I've tested this with flan-t5-small model with the following configuration.
training_args = TrainingArguments(
    run_name="abc",
    output_dir="outputs",
    num_train_epochs=1,
    per_device_train_batch_size=16,
    per_device_eval_batch_size=16,
    gradient_accumulation_steps=2,
    learning_rate=9e-1,
    max_grad_norm=10.0,
    optim="adamw_hf",
    evaluation_strategy="steps",
    eval_steps=350,
    logging_strategy="steps",
    logging_steps=50,
    logging_first_step=True,
    save_strategy="steps",
    save_steps=300,
    fsdp="auto_wrap",
    fsdp_config={
        "xla": True,
    },
    remove_unused_columns=False,
)

trainer = DPOTrainer(
    model=model,
    ref_model=model_ref,
    args=training_args,
    beta=0.1,
    train_dataset=dataset_train,
    eval_dataset=dataset_test,
    tokenizer=tokenizer,
    max_length=512,
    max_prompt_length=512,
    max_target_length=512,
)

Here's the training loss I get, and it doesn't necessarily decrease.

I think there's more to this since as my own experimentation with the original DPO repo by eric-mitchell resembled a very similar DPO loss: here

Not stale!

#586 is in a great shape and should be merged soon!


multiple log files reading fail

i have multiple log files want to analyse。but access.log  is empty,so when i start goaccess ,it's fail.
the access.log.0  was split from access.log. is it bug?
goaccess  -q --config-file=.goaccessrc  /data/amc/nginx/install/logs/access.log.0  /data/amc/nginx/install/logs/access.log

Can you please try building from development and see if that issue has been addressed upstream? Thanks.


Adding new pages fails with "Data too long for column 'translation_key' at row 1"

Wagtail 6.0.1
Django 5.0.3
MariaDB 10.11
Adding a new page in wagtail  fails with
DataError at /iadmin/pages/add/xxx/
(1406, "Data too long for column 'translation_key' at row 1")

The cause is that UUIDFields like translation_key need a patch for MariaDB >= 10.7, as described
in the Django 5 release notes  https://docs.djangoproject.com/en/5.0/releases/5.0/#migrating-existing-uuidfield-on-mariadb-10-7
Please provide migrations for this.

Confirmed on current Wagtail. Starting from a fresh virtualenv and running mariadb server:

pip install django<5 wagtail mysqlclient
wagtail start wagtailmaria
edit wagtailmaria/settings/base.py:DATABASES = {
    "default": {
        "ENGINE": "django.db.backends.mysql",
        "NAME": "wagtailmaria",
        "USERNAME": "...",
        "PASSWORD": "...",
    }

./manage.py migrate ; ./manage.py createsuperuser ; ./manage.py runserver
log in; editing and creating pages works fine
pip install -U django
now creating a new homepage at the top level fails on save with django.db.utils.DataError: (1406, "Data too long for column 'translation_key' at row 1"), and editing the existing homepage fails with django.db.utils.DataError: (1406, "Data too long for column 'uuid' at row 1")

This is going to be a tricky one to resolve across all environments. I can add the migration as directed by the Django docs (https://github.com/gasman/wagtail/commit/68c111652b08591b038841948d42ab71975b8178) and that does fix a project that was created under Django 4.2 and broken in an upgrade to Django 5.0 - however, a new project created under Django 5.0 (and using MariaDB's native UUIDField with no issues) now fails when running that migration with Data too long for column 'translation_key' at row 1. I see it's also failing on non-MariaDB databases, presumably because those are implementing UUIDField as a CharField with the hyphen separator, which means they don't fit into a char(32). I suspect the Django developers didn't consider reusable cross-platform apps like Wagtail when they rolled that change out (and wrote the release note for it) :-(
To make matters worse, it's not just Wagtail's own apps that will need migrations - one of the UUIDFields in question is in TranslatableMixin, so changing that at Wagtail's end will trigger a migration in any app that defines a translatable snippet model, including on non-MariaDB-based projects.
I think the answer might be to side-step the migration mechanism entirely, and provide a management command that developers can run at the point that they upgrade to Django 5.0 (or MariaDB 10.7, whichever one happens later), which finds all the affected CharField-based UUIDFields and runs an ALTER TABLE to convert them to native UUIDFields. (In other words: "rewrite this database to behave as if its migrations were run under Django 5.0/MariaDB 10.7".)

just a note:

I applied the patch suggested in the Django5 release notes to the 3 instances of UUIDfield in the 3 files wagtail/models/{i18n.py, audit_log.py, reference_index.py}  and this works for me (without any db migration). Of course, this is not an universal solution.
The update of MariaDB which triggered the problem happened when I updated a Debian/stable server from Debian 11 to Debian 12.


Describe the bug
UUID::uuid4 generates a UUID containing a 'y' in the first number set.
"dabfy08d-3aa6-11e9-b1fd-00163e76b1b2"
The number generates, and is accepted by Doctrine during persistence, but then fails when hydrating on loading.
Uncaught PHP Exception Doctrine\DBAL\Types\ConversionException: "Could not convert database value "dabfy08d-3aa6-11e9-b..." to Doctrine Type uuid"
To Reproduce...
Can't reproduce, seems random.
Expected behavior
Expect to generate a number that validates.
Screenshots or output

Environment details

LAMP
PHP version: 7.2
ramsey/uuid version: 4.1.1
ramsey/uuid-doctrine version: 1.6.0

Additional context
/**
 * @var string
 *
 * @ORM\Column(type="uuid", unique=true)
 * @ORM\Id
 * @ORM\GeneratedValue(strategy="CUSTOM")
 * @ORM\CustomIdGenerator(class=UuidGenerator::class)
 */
protected $id;

Sorry, disregard. This UUID was generated prior to using the Ramsey bundle.

Thanks for letting me know!


AppConfigurationRefresh with Spring Boot 3

Hello,
I am using:
implementation("com.azure.spring:azure-spring-cloud-appconfiguration-config:2.11.0")

and when we upgraded to spring boot 3.0.6 app can't find bean which is implementing interface AppConfigurationRefresh.
My usage is stadnart we have our bean:
@Configuration
@EnableScheduling
class AppConfigurationUpdater(val appConfigurationRefresh : AppConfigurationRefresh) {

If i look directly which class is implementing AppConfigurationRefresh interface, there is bean in the library:
@Component
public class AppConfigurationPullRefresh implements AppConfigurationRefresh {

Problem is that after upgrade to spring boot 3 app can't see it (with spring boot 2.7.9 it was working as expected):
caused by: org.springframework.beans.factory.NoSuchBeanDefinitionException: No qualifying bean of type 'com.azure.spring.cloud.config.AppConfigurationRefresh' available: expected at least 1 bean which qualifies as autowire candidate. Dependency annotations: {}

Any clue why? Any comments are appreciated.
Regards
Lukas

@wondris009 that version doesn't support Spring Boot 3, you need to use:
implementation("com.azure.spring:spring-cloud-azure-appconfiguration-config:5.1.0")

Wow. I couldn't find it. Many thanks.


Something is broken in TZ...

:) I'm already on the next point, no tz defined in python possibly... still investigating. thanks to the nice logs, it should be easy to pinpoint.
Originally posted by @edgd1er in https://github.com/Py-KMS-Organization/py-kms/issues/3#issuecomment-942653761

something like this might be required to define TZ in the entrypoint, still working on it....
#Change timzeone if set
[[ -n ${TZ} ]] && [[ -f /usr/share/zoneinfo/${TZ} ]] && [[ -w /etc/localtime ]] && ln -fs /usr/share/zoneinfo/${TZ} /etc/localtime
#use UTC if not
[[ ! -f /etc/localtime ]] && ln -fs /usr/share/zoneinfo/Etc/UTC /etc/localtime
-> https://github.com/Py-KMS-Organization/py-kms/issues/3#issuecomment-942672079

I will need to add this as a fix to the Helm chart

I have TZ ok (through env var)+ log for client on stdout.
I try to change now uid/gid of user as I need to have specific id/gid on mounted volume and drop root privileges after having set TZ and UID/GID.. without any luck til now. I might have to split entrypoint in 2. My fork might be already to different from yours.


Handle empty author names

Although git does expect that author names should be of the form: NAME <EMAIL> some users have been able to create commits with: <EMAIL>
Fix #21900
Signed-off-by: Andrew Thornton<EMAIL_ADDRESS>

We need to trim space of the name.

Please send backports


Implement all rules

Currently, this linter does not catch all of the rules in standard-readme. This is because we have not created all of the rules needed to match the spec in standard-readme. These rules will be added to standard-readme-preset.
This is the official tracking issue for these rules.

Hey, how is this going? Currently only the headline is throwing an error.

@lukasoppermann Yep. There haven't been any pushes yet; I need to have some more development time, but I'm currently on a semi-holiday in Scotland and do not have a lot of time for coding. Early June will be more productive. :) If you'd like to jump in and make some rules, feel free! :D

Jesus, I just looked through the chain required to add a rule. That is a lot of work. I thought they were already done in the spec. Sorry not able to help with this atm. But I understand why this takes a while. I am already adding standard-readme to every new package I build. 😉
Anyway, enjoy your holiday.

Yep. It'll be some work. That's OK! It'll be worth it.

@lukasoppermann Before any programming starts, we first need a list of rules that can be implemented based on the spec.

filename: should be README.md or README.$bcp47.md; readme.md, Readme.md, README.mkd, and the like are invalid.
...

So maybe you’d be able to help with that?

That's right, @wooorm! Sorry for the delay. Traveling. Great meeting you in Berlin. :)

Yes, definitely! And no problem at all, enjoy your semi-holiday!

Seems

It's got a lot of work which needs to be done. :) Happy to look at PRs.

Any update on this? :-)

No plans at the moment. Focusing on other things. PRs accepted.
On Sat, Jul 1, 2023 at 4:33 PM Jesús Leganés-Combarro <
@.***> wrote:

Any update on this? :-)
—
Reply to this email directly, view it on GitHub
https://github.com/RichardLitt/standard-readme-cli/issues/4#issuecomment-1615963754,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AAG6LIKD47HDW2MEFI5UYYTXOA7MTANCNFSM4DKQCD5Q
.
You are receiving this because you authored the thread.Message ID:
@.***>

--
Richard | burntfen.com http://www.burntfen.com | @richlitt
https://twitter.com/richlitt | @@.***


Return empty array when there is no data

Grafana v7.1.5 (9893b8c53d) produces an error when the datapoints field is null. It expects an empty array.

@ibzx Thank you for the pull request!


Implementation of Annotorius and angular JS in ConedaKor database

Hi Igorlino !
Thank you so much for your great job, I really appreciate the quality of your code. It really helps me with my issue : I'd like to integrate Annotorius in Conedakor database ([https://github.com/coneda/kor]). The new version of the database will use angular JS. I try to use Annotorius in my view, but it doesn't work. I can see the icon "click and drag to annotate" top left on my image but I can't annotate, what's frustrating ... I try to integrate your library angular-annotorius and put the name of the directive in the img element but it also doesn't work.
My angular js directive kor-anno :
kor.directive "korAnno", [
  "$http",
  (http) ->
    directive = {
      link: (scope, element, attrs) ->
        myImage = jQuery(element)
        myImage.bind 'load', ->
          console.log('loaded')
          scope.$apply ->
            anno.makeAnnotatable(element[0])
        #myImage.on "mouseover", (event) ->
        #  #event.preventDefault()
        #  console.log "qsdf"
        if myImage
          console.log("img picked up")
          console.log(myImage)
        window.e = element
      priority: 100
    }
]

the code about the view :

         Quit annotation

Nam vitae bibendum nunc. Pellentesque a aliquet orci, eget dictum ligula. Donec non molestie arcu. Morbi dignissim, libero non semper lobortis, neque elit fermentum risus, ac congue nibh sem quis ex. Fusce in fermentum orci, non pellentesque urna. In ac mauris et urna aliquet tincidunt.

I presume it's not a timing issue, images are loaded before the directive. I put priority level 100 for kor-anno and ng-src is level 99. I also check the networks tab and Annotorious has loaded. I'm getting lost ...

Hi Anne-Cecile,
I will try update the demo page a bit better.
Meanwhile there is an explanation at:
http://stackoverflow.com/questions/30720798/how-to-use-annotorious-with-angular/30720811#30720811
(feel free to vote and/or comment on it)

BTW I don't think you need to implement your own annotorious directive.
I will try put an example how to integrate with local cache. perhaps that gives a further hint.

Hi ! Thank you for your help, Igorlino. It's actually a problem with the loading of images. I put a timeout function with 2500 ms on makeAnnotatable in my directive and it works. I guess the issue concerns the image loading which takes 2 seconds :)

I see, well still its a kind of dynamic content issue. Either you use jquery hack ready to wait for loading the page/resources/images. Or you could use something like http://stackoverflow.com/questions/18627609/angularjs-resolve-to-wait-until-external-images-have-loaded
that tells you when images finish loading. At least thats the direction I would go if I had to do the same you need to do.
Also, you may want NOT  to use directly the "anno" object. Instead you could use the "annotoriousService" angular service from the angular-annotorious library.

Ok, seems its not a bug in the angular library code base. I'm closing this issue. Thanks for your showing your example usage.


Data fetched at docker run to decrease container size

At image build, docker build -t containername -f topics/topicname/docker/Dockerfile ., only the data-library.yaml files are merged, the way it used to, but the data itself is not downloaded.
When you use the normal run command  docker run -p "8080:80" containername the container will run without the example data.
When the command  docker run -p "8080:80" containername -d is used, the corresponding data libraries of that topic will be downloaded and accessible within the training environment.
This reduces the size of the images enormously, enabling them to be uploaded to docker hub or quay.io

if this idea will be implemented, we should also change planemo to generate the new docker files with the new
ADD bin/datalibrarydownload.sh /datalibrarydownload.sh
ENTRYPOINT ["/datalibrarydownload.sh"]

lines

@bgruening What do you think of this implementation? Or would you still prefer to incorporate this function inside the galaxy-stable base image.

@bgruening I checked the building of several topics, and it works like a charm. Only concern: when I wanted to build the containers in windows, I had some line ending problems in the bash scripts. (although on github LF is used ...  ). But that is a windows thingy.. I think it can be merged. Biggest container now is 28 gig for transcriptomics.

@bgruening Done !

Merci!

@bedroesb you might want to inform Frederik about this. He probably wants to put this in some fancy GDoc for ELIXIR.


Add how to use multiple streams in loaders in yaml

Users asks for an example to use multiple streams (https://github.com/mosaicml/streaming?tab=readme-ov-file#seamless-data-mixing) through yaml file.

Done in another PR


The segment status is ERROR

If I upload the segment status offline to pinot, it is ERROR. What is the reason？

Have you looked at what the servers log for the segment?

I haven't read the servers log yet, but the feedback from the uploaded client is that the data upload was successful


problem with building bwt inorder to run ebwt2indel

Hello,
I'm trying to use ebwt2InDel to find SNPs in sequencing reads. I'm using the following code to build bwt of my paired end reads.
BCR_LCP_GSA 9_S6_L004_R1_001.fastq.gz 9_S6_R1.fastq.bwt
BCR_LCP_GSA 9_S6_L004_R2_001.fastq.gz) 9_S6_R2.fastq.bwt
I have removed the reads containing N prior to running the job. However, I kept getting an error indicating "The  (new and-or old) reads have a different length".  And following that, I processed the reads with fastp to make all the reads of equal length, but I'm still getting the same error. I also tried including zcat to unpack the reads, but the same error.
The error;
TIMER start buildBCR User: 3e-06s System: 1.1e-05s Actual: 1.6e-05s Efficiency: 87.5%
The  (new and-or old) reads have a different length.
BCR_LCP_GSA: TransposeFasta.cpp:235: bool TransposeFasta::findLengthNseq(const string&, const string&, std::__cxx11::string): Assertion `lengthSeqVector.size() == nSeq' failed.
/var/spool/torque/mom_priv/jobs/29994642.moab.SC: line 15: 38504 Aborted                 (core dumped) BCR_LCP_GSA <(zcat 9_S6_L004_R1_001_no_N_151.fastq.gz) 9_S6_R1.fastq.bwt
Please help in clarifying if there is something I'm doing wrong
Best regards,
Kedra

Hello! This is an error of BCR_LCP_GSA, so you should open the issue there: https://github.com/giovannarosone/BCR_LCP_GSA
Best
Nicola

Hello! This is an error of BCR_LCP_GSA, so you should open the issue there: https://github.com/giovannarosone/BCR_LCP_GSA
Best
Nicola


run nuget deprecation via arg

@weshaggard please review when you have a chance, thanks.

@mario-guerra what is your goal with this change? Is it to run it locally for debugging? You can run the pipeline if you want to see the results.

@weshaggard yes, the goal is local debug.

@weshaggard how does this version look?
Example of updated deprecation message:
https://www.nuget.org/packages/Microsoft.Azure.Management.Batch

/azp run azure-sdk - ci


[Bug]: Radiogroup not working for Id->String values

Is there an existing issue for this?

[X] I have searched the existing issues

Current Behavior
Default selected value is only pre-selected if the Options values are specified as strings.

Notably, the select widget does allows int to string mapping and behaves as expected, so it can effectively be used as a workaround if string mapping is not possible

Steps To Reproduce
Set the radio group items as a label-value as a string->integer map  as follows:

You'll notice that the radio group has no pre-selected item
Environment
Production
Version
Cloud

The problem here is very similar to the select widget where the default data is automatically treated at string.
We should treat the value type as is to resolve the problem. @SatishGandham please correct me if I am wrong.

@somangshu I think this is actually why the select widget always works.. you throw it a string.. or a number or anything... and it always converts it to string so you can always match... unlike the radiogroup which will probably take the value as is.. and sometimes it will be an integer and sometimes a string... so it doesn't match.. even though for most purposes 3="3"

You are right. The default value is always an integer until you use the mushtach barceses. We will keep you posted for the right solution we are going to opt. Thanks for the additional context

To solve this issue, we have decided to go with keeping value present in the default selected value to be evaluated to integer if it's mushtach binding. We will also change the expected type and example in the evaluated value popup.
CC: @somangshu @dilippitchika @Nikhil-Nandagopal

@riodeuno FYI, Here we are changing the checking the dataType from the first object in the options collection and based on that deciding weather on change we should parse the value to return, Is this the right way?

@somangshu Here, if the value properties can be of different type in different entries, then we may have issues making assumptions based on the first entry. There will be other issues as well, for example, where "1" and 1 can both be valid values. What would an Appsmith developer provide as the default in this case?
So, we might want to validate this as well, for integrity.
In other words, the ideal way in which -- the combination of options and default value -- may work

[ ] The data type of value properties in the options are consistent (enforced via validations)
[ ] default values are considered to be of the same type as the values. The approach you mentioned works.

@keyurparalkar @sbalaji1192 need inputs from you guys on the above

@somangshu I think we should go with option 2. Were we consider default values to be of the same type as values
What do you think @sbalaji1192 ?

@keyurparalkar @somangshu Let's go with @riodeuno suggestions. We will enforce that all values data type is equal and then we infer the type from the first option to get the default value type.

cc @dilippitchika keeping you in the loop


index: build: introduce build_entry() and build_entries()

This is useful when trying to modify existing index.

Codecov Report
Base: 52.95% // Head: 53.00% // Increases project coverage by +0.04% :tada:

Coverage data is based on head (279944f) compared to base (c660941).
Patch coverage: 83.33% of modified lines in pull request are covered.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #198      +/-   ##
==========================================
+ Coverage   52.95%   53.00%   +0.04%
==========================================
  Files          47       47
  Lines        2723     2730       +7
  Branches      466      385      -81
==========================================
+ Hits         1442     1447       +5
- Misses       1215     1216       +1
- Partials       66       67       +1

Impacted Files
Coverage Δ

src/dvc_data/index/build.py
83.33% <83.33%> (-4.91%)
:arrow_down:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report at Codecov.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.


Profile fails to update after creating or deleting post

The tile is pretty much self explanatory.
I have the latest version of Ramme installed (updated today), however when I upload an image, caption it, etc, the post is uploaded fine, however it does not appear on my profile when i look at it with Ramme.

@anatolinicolae What do you think about this issue? We might need to add a refresh of the page after adding a new image

Check current URL and force cmd+R/ctrl+R on change I guess. Have to look again in the app structure and I'll let you know 😉


Add context path to logged endpoints

Problem:
Endpoints logged out take into consideration jersey's URL pattern, but not the context path.
GET /endpointA
POST /endpointA

Copy pasting this URL gives 404s if you have context-path
Solution:
Append context path if present to the end points along with jersey URL pattern
Result:
GET /context-path/endpointA
POST /context-path/endpointA

Just to double check if I understand you right, now everyone that uses
server:
  type: simple
  applicationContextPath: /application

Will see
GET /application/endpointA

instead of
GET /endpointA

@nickbabcock Yes, that's it. So that consumers can copy pasting from the console directly get the context path without looking anywhere else (We have quite a few including myself)

I think this change is justified. I can imagine situations when operations staff tries to diagnose a service by the logs and expect that the logged endpoints correspondent to actual endpoints.

@afrin216 Thank you for the contribution!


Commit-msg does not seem to work

Hi, I am trying to migrate from Husky. I've added the following to my package.json:
"simple-git-hooks": {     "pre-commit": "lint-staged",     "commit-msg": "yarn commitlint -E --from=HEAD~1"   },
I try to run:
$ git add .
$ git commit -m "testy: testy"
// works
BUT
yarn commitlint -E --from=HEAD~1"
`
⧗   input: testy: testy
✖   type must be one of [build, chore, ci, docs, feat, fix, perf, refactor, revert, style, test] [type-enum]
✖   found 1 problems, 0 warnings
`
To test, I have tried to echo a string in the commit message spot but I still don't see it. Is this user error or a package problem? Thank you.

i was able to get this resolved by ensureing that the the package was installed
scripts: {
"postinstall": "npx simple-git-hooks"
}
and then
"simple-git-hooks": {
"pre-commit": "yarn tsc && yarn lint-staged",
// perhaps this could be added to the readme?
"commit-msg": "yarn commitlint -e "$@""
},


24h time in military format (no colons)

Feature Request
It will be very helpful to allow typing time in 24h format (e.g. 2359) without colons.

fewer keystrokes
cleaner interface
globally understood -- google calendar supports it too, e.g. a new event "Doctor Appointment 1300-1500" is parsed as expected

Are you referring the daily log?

Yes, the Journal page


breaking change

Signed-off-by: Phil Prasek<EMAIL_ADDRESS>

pull_request_target is not needed for private repos or PRs from in-repo branches (vs. forks from public repos), so closing this in favor of #32 to demonstrate schema checks with breaking changes.


Add helper functions

SingleOrNothing (with and w/o predicate)
JustNotEmpty
Cast

As discussed: SingleOrNothing postponed, since the Exception for multiple entries from Enumerable Extensions needs to be considered. One alternative would introduce Exceptional monads and monad stacks for this function alone.

JustNotEmpty is intended for strings?
What should Cast do?

Cast<T> is Map<T> without a function passed.
JustNotEmpty can be ignored, as I don't know what it was for.

I*d like to do Cast for Maybe values as up cast when T:TUp because that way it can be  checked by the compiler and we do not get runtime errors we would get for invalid down casts.
This would definitely help with some covariance issue, even though it is not perfect.
However, I don't see a convenient way to do this for now, without an extensions with two generic parameters which will make this not really simple to use.
Maybe there is a way to implement up casts with an implicit conversion operator.

I have no idea at the moment. We can move it to a separate issue.

Resolved with #8


Add version: qarmin.czkawka.cli version 5.0.2

Pull request has been created with komac v2.0.3 :rocket:
Microsoft Reviewers: Open in CodeFlow

Automatic Validation ended with:

No errors to post.

(Automated response - build 708.)

Automatic Validation ended with:

No errors to post.

(Automated response - build 720.)


libGLFW is not installed as part of the MaterialXGraphEditor target

The MaterialXGraphEditor target has a dependency on libGLFW. However this does not get installed when building the graph editor, causing it to be non functional unless the libraries get copied over.
I see that it sets GLFW_INSTALL to OFF , which is oddly what the NanoGUI build does for the Viewer too.
I do however see that NanoGUI says this in its cmake
# Two targets have now been defined: `glfw_objects`, which will be merged into
  # NanoGUI at the end, and `glfw`.  The `glfw` target is the library itself
  # (e.g., libglfw.so), but can be skipped as we do not need to link against it
  # (because we merge `glfw_objects` into NanoGUI).  Skipping is required for
  # XCode, but preferable for all build systems (reduces build artifacts).

Perhaps something similar needs to be done for the GraphEditor so it doesn't have a hard link against libGLFW? or we need to enable the install.
Enabling the install however does cause this error to pop up during the build despite that file existing.
source/MaterialXGraphEditor/External/Glfw/CMake/cmake_uninstall.cmake.in does not exist.
However I do see the file exists on the nanogui side: MaterialXView/NanoGUI/ext/glfw/CMake/cmake_uninstall.cmake.in
So I just wanted to see if there was any insight on why the file was removed, and why the install is disabled? also if there were any ways we could move forward and either inline the symbols or install the lib?

These are great notes, @dgovil, and we'd be happy to move forward with either NanoGUI-style GLFW merging or reenabling of GLFW installation.  We disabled GLFW installation to keep its footprint as minimal as possible within MaterialX, but it would be fine to add this support back if that proves to be the most natural path forward.

Ah yeah that makes sense why you did that.
I think either option you mentioned would be good. It would make the default build+install more intuitive for folks.

Is this still an issue ?
My default macOS build of MaterialXGraphEditor for Dev Days seems functional without an install of GLFW, it seems. The resulting executable is simply statically linked against libglfw3.a at build time. Here are my steps to build and run it:
mkdir build
cd build
cmake  -DMATERIALX_BUILD_GRAPH_EDITOR=ON ..
cmake --build .
cmake --install .
installed/bin/MaterialXGraphEditor

Happy to look into this more if needed.

Thanks for that note, @nicolaspopravka, and I'm CC'ing @dgovil to see if this is still an issue that needs to be resolved on macOS.  I haven't encountered this issue in our Linux and Windows builds of MaterialXGraphEditor, but there may be dependencies on specific build choices or environments.

Ah yeah I haven't hit this in a while either so I think it all works. I'll close this out.

Actually, @jstone-lucasfilm we're seeing this again so maybe my testing wasn't thorough. I'll reopen and Lee has a proposed solution.

I was digging through some stuff on outside and I think what Nicolas is saying above is 99% correct.  If we link against glfw statically, then all will be good.  But if MATERIALX_BUILD_SHARED_LIBS is set to ON (which is NOT the default).  Then that propagates BUILD_SHARED_LIBS=ON down in to the glfw cmake build.
It looks trivial to amend that so we force glfw to always build static, which I think will take us that final 1% of the way to success - I'll put up a PR soon.


Change pip.sh to take Bazel flags directly so AVX packages are built properly

Cherry-pick for r1.0 branch

Abandoning since it's not needed anymore. Built off of my own github branch since I needed another change there.


Rename preview doesn't work

Testing https://github.com/microsoft/vscode/issues/204370
On the latest Insiders on Windows:

F2 to rename a variable
Rename the variable, but instead of pressing Enter to apply the rename, press Ctrl+Enter
:bug: Nothing happens

Fixed after disabling Copilot Chat

I can't repro:
https://github.com/microsoft/vscode/assets/16353531/821f8f53-b35a-4f6b-8000-4054962b822c
Version: 1.88.0-insider (user setup)
Commit: 246d700c4604eb5ebdbb561a1a86562bf9217a62
Date: 2024-03-27T05:50:10.528Z
Electron: 28.2.6
ElectronBuildId: 27476517
Chromium: 120.0.6099.291
Node.js: 18.18.2
V8: 12.0.267.19-electron.0
OS: Windows_NT x64 10.0.22631

Same for me, I have not been able to reproduce as of yet. I will keep an eye out for this issue.


pg: Add support for INET/CIDR-specific operators and functions

This PR adds support for postgresql-specific INET and CIDR types. In this PR, support is added in the query builder for:

<<, >>=, etc operators
host, masklen, ... functions

Thanks for opening this PR. We do not backport new features to old releases. Therefore I'm closing this PR in favor of #2566.

Oh ok I thought a 1.4.6 release would be possible. Thanks for your time!
Is there any details on when 2.0 is to be expected?

A 1.4.6 release is certainly possible, but as a patch release it should only contain buf fixes and dependency version bumps and no new features.
The timeline for the 2.0 release is: As soon as all required features are implemented (see the corresponding milestone for details). We do nit give other estimates there as this is a project run in our free time and at least I don't know how much time I'm able I will spend working diesel.


Missing ws dependency

I think you're missing an explicit declaration of ws as a dependency.
$ npm run dev

error when starting dev server:
Error [ERR_MODULE_NOT_FOUND]: Cannot find package 'ws' imported from<EMAIL_ADDRESS>    at new NodeError (node:internal/errors:399:5)
    at packageResolve (node:internal/modules/esm/resolve:889:9)
    at moduleResolve (node:internal/modules/esm/resolve:938:20)
    at defaultResolve (node:internal/modules/esm/resolve:1153:11)
    at nextResolve (node:internal/modules/esm/loader:163:28)
    at ESMLoader.resolve (node:internal/modules/esm/loader:838:30)
    at ESMLoader.getModuleJob (node:internal/modules/esm/loader:424:18)
    at ModuleWrap.<anonymous> (node:internal/modules/esm/module_job:77:40)
    at link (node:internal/modules/esm/module_job:76:36)

Running npm -i ws fixes the error.

Ah, makes sense! I did run npm -i ws in my test project during development so I forgot to move it from dev dependency to just dependency. It should now be added.
Thanks for your help! 😃

Thanks!


[Feature] To show weather of user's location first.

I think the app should be able to give weather details our position first by detecting it, before searching for other locations

Great idea, indeed! Can you explain your approach for the same, @Freedisch!

@Freedisch there won't be any need of searching bar if we ask for location permission from user to show their location directly

@harshk-codes There is still a need of the searching bar bcs with it, he will be able to check the weather for other location

cool

Yes, @Freedisch! You can start working on it.

I have wrote a python code to map user location on a map. Should I PR it?

I have wrote a python code which will show the user a graph of weather of his current area between a particular duration of time.
This is the output  where the three lines are max, min and avg temperature.

Create a folder 'python' and add it @gsm005
How can you implement it in this project?

Actually I am new to  Development. And Currently I have knowledge about Python and CPP only.
So, maybe we can make this graph display on the website or app.

No problem, @gsm005 !
Create a folder 'python' and add it. Also add sample screenshots of graphs.

Done!

Can We Add Air Quality index also ?

I think we can ask for user preferred location and show the preferred location and if user does not enter something app can show him default location. I would like to work on it.

Can We Add Air Quality index with Weather information ?

Good idea. 🚀
Share your approach. How will you implement?

I think we can ask for user preferred location and show the preferred location and if user does not enter something app can show him default location. I would like to work on it.

Showing the current location weather first seems better.


Multiple reactants

Hi,
My template rule has two reactants. May I know how can I input two reactants in the product_smiles = rdchiralRunText(rule, reactant_smiles). For example, the smiles for my reactants are O=C([O-])CCC(=O)C(=O)[O-] and [NH4+].

RDChiral is mostly meant for retrosynthetic reactions starting from a single product (based on the way it handled ambiguity). If you want to repurpose it for a template with multiple inputs, you should just use a concatenated SMILES O=C([O-])CCC(=O)C(=O)[O-].[NH4+]

Hi, Thanks for the reply!
If I use the concatenated SMILES as the input, there would reports an error
ValueError: ChemicalParserException: Number of reactants provided does not match number of reactant templates.
The code I am using is:
rule = '[C:1]-[C;H0;D3;+0:2](-[O-;H0;D1:5])=[O;D1;H0:4].[NH4+;D0:3]>>[C:1]-[C;H0;D3;+0:2](-[NH2;D1;+0:3])=[O;D1;H0:4].[OH2;D0;+0:5]'
product_smiles = rdchiralRunText(rule, 'O=C([O-])CCC(=O)C(=O)[O-].[NH4+]')

Your rule should be written as a pseudo-unimolecular reaction by grouping the two SMARTS fragments. See if this works:
rule = '([C:1]-[C;H0;D3;+0:2](-[O-;H0;D1:5])=[O;D1;H0:4].[NH4+;D0:3])>>[C:1]-[C;H0;D3;+0:2](-[NH2;D1;+0:3])=[O;D1;H0:4].[OH2;D0;+0:5]'

Thanks!


handle nil return

Current dependencies on/for this PR:

main

PR #9   👈

This comment was auto-generated by Graphite.


Closes #93 Update readme and doc script

Thank you for your Pull Request! We have developed this task checklist from the Development Process Guide to help with the final steps of the process. Completing the below tasks helps to ensure our reviewers can maximize their time on your code as well as making sure the admiral codebase remains robust and consistent.
Please check off each taskbox as an acknowledgment that you completed the task or check off that it is not relevant to your Pull Request. This checklist is part of the Github Action workflows and the Pull Request will not be merged into the devel branch until you have checked off each task.

[x] Place Closes #<insert_issue_number> into the beginning of your Pull Request Title (Use Edit button in top-right if you need to update)
[x] Code is formatted according to the tidyverse style guide. Run styler::style_file() to style R and Rmd files
[x] Updated relevant unit tests or have written new unit tests, which should consider realistic data scenarios and edge cases, e.g. empty datasets, errors, boundary cases etc. - See Unit Test Guide
[x] If you removed/replaced any function and/or function parameters, did you fully follow the deprecation guidance?
[x] Update to all relevant roxygen headers and examples, including keywords and families. Refer to the categorization of functions to tag appropriate keyword/family.
[x] Run devtools::document() so all .Rd files in the man folder and the NAMESPACE file in the project root are updated appropriately
[x] Address any updates needed for vignettes and/or templates
[x] Update NEWS.md if the changes pertain to a user-facing function (i.e. it has an @export tag) or documentation aimed at users (rather than developers)
[x] Build pharmaverseadam site pkgdown::build_site() and check that all affected examples are displayed correctly and that all new datasets occur on the "Reference" page.
[x] Address or fix all lintr warnings and errors - lintr::lint_package()
[x] Run R CMD check locally and address all errors and warnings - devtools::check()
[x] Link the issue in the Development Section on the right hand side.
[x] Address all merge conflicts and resolve appropriately
[ ] Pat yourself on the back for a job well done! Much love to your accomplishment!

The create_adams_data.R script has to be rerun in order to generate new scripts with the updated documentation. I can't do it from my PC as GitHub puts a limit on the amount of API calls.

@vbshuliar in addition to my above review can you please also restructure the reference page so that it talks about datasets and not functions? thanks


sample

Changelog

Add
Fix
Update

Reviewed by
@developer_github_id
Linked issue
#issue_number

Please check https://github.com/hyperledger/bevel/blob/main/CONTRIBUTING.md

This is not a valid request and the changes will be incorporated in a separate PR that I have worked upon.


ARROW-1754: [Python] alternative fix for duplicate index/column name that preserves index name if available

Related to the discussion about the pandas metadata specification in https://github.com/pandas-dev/pandas/pull/18201, and an alternative to https://github.com/apache/arrow/pull/1271.
I don't open this PR because it should necessarily be merged, I just want to show that it is not that difficult to both fix ARROW-1754 and preserve index names as field names when possible (as this was mentioned in https://github.com/pandas-dev/pandas/pull/18201 as the reason to make this change to not preserve index names).
The diff is partly a revert of https://github.com/apache/arrow/pull/1271, but then adapted to the current codebase.
Main reasons I prefer to preserve index names: 1) usability in pyarrow itself (if you would want to work with pyarrow Tables created from pandas) and 2) when interchanging parquet files with other people / other non-pandas systems, then it would be much nicer to not have __index_level_n__ column names if possible.

Regarding the PR backlog, given the comments above I think there was agreement to merge this.
There are no merge conflicts yet, but should I update with master to ensure tests are still passing?

@jorisvandenbossche Yep that's a good idea, I can merge on green.

Seems like this could be a stale merge -- doesn't look like it got the ARROW-2062 patch

I see the ARROW-2062 commit in the history of this branch: https://github.com/jorisvandenbossche/arrow/commits/index-names (I fetched upstream master just before I merged / pushed)
But, it is failing on travis (amongst others, a timeout for the first (gcc) build), is that the reason you were thinking this is not up to date?

It looked a lot like the failure that was happening before ARROW-2062, I triggered a new build to see if it's transient

Hmm, still timing out on the first one (but the other failures seems resolved)

No problem, I'm merging this, thanks @jorisvandenbossche!

Thanks for merging!


@connectActionSheet do not copy statics

I'm using @connectActionSheet in a Route component of ex-navigation
and the wrapped component does not have the static route.
I can send a PR using this package https://github.com/mridgway/hoist-non-react-statics if this makes sense

something like this: https://github.com/exponent/ex-navigation/blob/master/src/ExNavigationConnect.js#L46

+1, broke my integration with react-navigation


Crash on trying to deserialize json string on 3ds homebrew

What is the issue you have?
When I try deserializing a string to json it crashes the app.

Please describe the steps to reproduce the issue. Can you provide a small but working code example?
json data = "{\"a\": [\"1\", 2], \"b\": true}"_json;

What is the expected behavior?
Deserializing json string

And what is the actual behavior instead?
An crash

Which compiler and operating system are you using? Is it a supported compiler?
I think arm-none-eabi-g++ or gnu++17, I use devkitARM. The operating system is 3DS for the app and Windows 10 Pro for development

Did you use a released version of the library or the version from the develop branch?
A released version

If you experience a compilation error: can you compile and run the unit tests?
I don't have either cmake or ctest.

What might help is the part of the make log I think is about this: https://hastebin.com/amomibogic.rb

What is the exact error message? Do you have a stack trace?

nope, just crashes the app and returns to the homebrew menu

https://hastebin.com/amomibogic.rb is the closest to an error message / stack trace

nvm, it got fixed, idk how


ItemList fails with complex items

Godot version:
3.0.6
OS/device including version:
macOS High Sierra 10.13.6 (probably OS independent)
Issue description:
ItemList with complex / custom items as children fail to display the items as a list. Instead everything is overlapping. The same item in a different container like VBoxContainer doesn't have the same problems, but misses all the features (hover, selection, scroll to focus, right click, ...)
Steps to reproduce:
Create an ItemList with complex items added with add_child() as neither of the add_*item convenience methods accept necessary parameters, for example:
+- ItemList
  +- HBoxContainer
    +- CheckButton
    +- Label (expand)
    +- Label (right align)
    +- CheckButton
    +- CheckButton

Minimal reproduction project:
ItemList Test.zip

I'm not sure ItemList is supposed to be used like that. ItemList generates its own elements.
If you want to make a list of controls ending up like ItemList, you should use ScrollContainer instead.

ItemList is not meant to be used like that. It doesn't inherit from Container unlike HBoxContainer. Only those inherited from Container can control their child size and position. It seems like it's working because of the inner HBoxContainer. If you replace the ItemList with any other Control nodes, it will do the same.

Possibly, I'm new to Godot and was looking for something to handle a list of items with basic mouse interactions taken care of already. Something like ItemList and/or PopupMenu without the popup bit but with fewer restrictions on what the item can be.

Having nested HBoxContainer and VBoxContainer is not uncommon. The editor is doing this too.
VBoxContainer
    HBoxContainer
        Label
        Button
    HBoxContainer
        Label
        Button
    etc.

or try GridContainer.

Instead of ItemList, nesting your containers inside ScrollContainer -> VBoxContainer will provide listbox style functionality.

Closing as working as expected, but we still want to hear the suggestion on improving the docs about ItemList so it's less confusing.


A simple plugin system

Right now, if I need to add my own custom stream nodes, I have to do this:
import mypackage.streamz_extras  # noqa: F401

It would be nice to have a way to distribute additional functionality as separate packages that can just be installed via pip. This can be done with entry_points, similar to the way it works in airflow. This is a super bare-bones implementation of this mechanism. Check out https://github.com/roveo/streamz_example_plugin for an example of a plugin.
Problems:

this should be tested, but I have no idea how, short of shipping the code for example plugin with tests
plugged-in classes should be checked for validity in some way. I can add a simple check e.g. isinstance(plugin, Stream), but there is probably something else I haven't thought of

Thank you. I totally agree that using entry_points is a great alternative or addition to the registration system.
@CJ-Wright @jsmaupin @chinmaychandak - anyone have time and interest to give this a once-over?

I think this is a great idea.  I was hoping that we could figure out how do this in the future for sources and sinks where you could connect Streamz to external services using packages install-able via pip or conda because, these connections often have a lot of dependencies that you don't necessarily want in your core package.  I hadn't considered it for functionality that operates in the middle of the pipeline. I think this is the step that gets us in that direction.

I think this is great! How should we document all these plugins so people can discover them?

If we go with entry_points as a way of declaring plugins, then we do not document them, at least not exhaustively. Intake faces this: we have a page of known plugins, which people can submit PRs for changing, but there's nothing to stop new plugins appearing which we don't know about. It would be possible to have a configuration that only loads a select number of plugins, or instead to not load the plugins except upon explicit user invocation.

I think is really nice!
I think for validating the plugins, we would definitely need isinstance(plugin, Stream) (similar to Airflow which tests against one of its subclasses called PluginManager which I don't think is necessary at this point).
Also, for testing an example plugin, having a separate repository/page called streamz-plugins could be an option? I think that's what Airflow does, too. The from_iterable node you wrote can be a good plugin for testing.
As for tests for future plugins, I think if we consider adding a plugin to setup.py in streamz, then we would need to verify the plugin behavior separately beforehand; if, however, we allow the plugin to be loaded lazily (only when the user explicitly invokes them, either through CLI or otherwise), then I think we don't need to worry about having tests in streamz itself (the plugin repo can have those tests, I mean). I'm just speaking my mind here, I may be missing something!

Also, for testing an example plugin, having a separate repository/page called streamz-plugins could be an option?
I think this is the way to go. Then I'll add tests, so that they are not bound to the repo in my account.

As for tests for future plugins, I think if we consider adding a plugin to setup.py in streamz, then we would need to verify the plugin behavior separately beforehand
So, plugins in streamz-plugins repo that are tested and "verified" can be provided via extras_require in setup.py, but nothing is stopping anyone from creating their own plugin package and installing it with pip.

This seems reasonable to me, although I would defer to Martin and CJ to make the final call whether or not this is the best way to proceed.

I see Travis builds timing out. Is this due to it being overloaded? Should we try something like install: travis_wait 30 mvn install temporarily?

We need to transfer our tests away from travis...

Yes, we should do whatever it takes to get travis to pass for now...
I am only now looking at the actual code. I wonder, is there any appetite for making this system lazy? As it is, streamz will import all packages that claim to have relevant plugins - but the node classes still need to be annotated with decorators as before.
I could imagine entry points spelled like:
streamz.plugins: [
  "transform=streamz_addon.module.TransformNode"
]

which adds "transform" to the dir() of Stream, but only imports and registers when the .transform is first used (i.e., via a __getattr__).
Furthermore, we may want to be more specific with our entrypoint group naming:

streamz.node
streamz.source
streamz.sink
...

What do you think?
btw: does this require the package entrypoints as a dependency?

I like having them lazy, since that allows us to not need the plugins to be installed until we actually need them

@martindurant would it be worthwhile to setup the CI using conda-forge's CI provisioning system? That way if we need to move to something we just rerender?

Sorry @CJ-Wright , you're the expert there, I really don't know what's involved.

I'll put up a PR if we're interested, but the rough outline is here: https://conda-forge.org/docs/user/ci-skeleton.html

Does it work for github actions CI?

Not yet, since CF doesn't use GH actions as a CI (yet). The hope of this approach would be that we don't need to care about what particular CI we are using, since we could rerender and the CIs could move.
We could add GH actions to CF and then it would support that CI.

In that case I am hesitant, since the dask repos are all going to github. I don't have a circle or azure account myself - is it all free like Travis used to be?

Sorry, can we move the CI conversation to an issue? I don't want to derail things here. https://github.com/python-streamz/streamz/issues/382

As it is, streamz will import all packages that claim to have relevant plugins - but the node classes still need to be annotated with decorators as before.

Do you mean that with lazy loading they won't have to be annotated?

adds "transform" to the dir() of Stream, but only imports and registers when the .transform is first used (i.e., via a getattr)

This can be done with a @property that looks it up in a class attribute dict (e.g. Stream._plugins) and loads the entrypoint if it's not already loaded.

Furthermore, we may want to be more specific with our entrypoint group naming

Do these types of nodes require different treatment when being loaded?

btw: does this require the package entrypoints as a dependency?

I don't think so, this is built into setuptools. entrypoints looks like a different package (with the last 2 releases in 2017 and 2019).

Indeed, this would be an alternative to the annotation; although doing both should be allowed for backward compatibility.

This can be done with a @property that looks it up in a class attribute dict (e.g. Stream._plugins) and loads the entrypoint if it's not already loaded.

Something like that, yes. There are many ways to achieve it. You would call register_api on the class once it's imported, so it gets added to the namespace and you don't need to import it again.

Do these types of nodes require different treatment when being loaded?

maybe. This gives us more flexibility for the future. We could argue that, for the time being, all possible plugins as "nodes" (i.e., they appear as attributes of Stream). My motivation here is, that in Intake we started off having things called "plugins", but then made other parts of the library pluggable and had to, painfully, rename the original plugins to "drivers".

I don't think so, this is built into setuptools.

Better check that setuptools has this functionality for all python versions of interest. Also, setuptools had better be included in the deps (yes, I know everyone already has it).

You would call register_api on the class once it's imported

Then register_api would have to allow us to specify which attribute the class will be registered at. Right now it's setattr(cls, func.__name__, modifier(wrapped)), so it's always the class name.

Better check that setuptools has this functionality for all python versions of interest. Also, setuptools had better be included in the deps (yes, I know everyone already has it).

OK, will do.

Correct. I imagine we'll have redundancy for now "name=package.module.name", but there might be a case for when we want the class name and method name to be different, which is not yet possible.
Actually, there is a difference between normal nodes and sources: the latter are registered as staticmethod.

@roveo, could you try something like install: travis_wait 30 mvn install in travis.yml, until we can switch from Travis to GitHub Actions / CF? I can't guarantee it will work (because the issue is due to Travis ending free builds), but I think it's worth a shot.

Better check that setuptools has this functionality for all python versions of interest.
Do we have a list of python versions that should be supported? Setuptools supported entry_points since 0.6a1 (year 2009), so I don't think this should be a problem.

Added Plugins page to docs (I'm not a native speaker, so edits and additions are very welcome).
Note that there's a table commented out in Known plugins section. I think at this point we should think about which existing functionality should go into extras (the leading candidate being kafka).

Right, but there aren't any yet :)
I actually would expect any plugin developers to contact us, if they wanted to be listed on the streamz documentation somewhere.

@chinmaychandak : that kafka test is failing too often! (and giving an incorrect message, due to using positional rather than keyword arguments to wait)

It was more of a general idea, since other plugin mediated systems could use that approach as well.


[gardening] Eliminate some unneeded llvm:: for types that we already inject into the swift namespace.

Just doing some cleanups in the generic specializer since I am looking at adding an early run at ossa time.

@swift-ci smoke test and merge


Moving dependencies and enabling a shaded jar

Removed pinot-core dependency on pinot-thrift, pinot-json and pinot-csv.
Instead, added these as dependencies inside pinot-hadoop and pinot-spark.
Enabled shaded build for the kafka common code so that we can export the
class AvroRecordToPinotRowGenerator for internal builds.
A better way to do this may be to move check-in external kafka connectors

Ensuring green and merging this


Unable to add multiple external networks in EIP and SNAT configuration

It is common in production that one segment/network of IPs are used up soon and is there a workaround in the current version to assign additional external gateway.

are you use iptables nat gw? or ovn eip snat?

We are using ovn eip snat
We are following the as per this documentation https://kubeovn.github.io/docs/v1.11.x/guide/eip-snat/  and assign a dedicated nic/vlan in "ovn-external-gw-config" configmap

It is common in production that one segment/network of IPs are used up soon and is there a workaround in the current version to assign additional external gateway.

in the case，will you add additional nic in the host（node）for this additional external gateway？

Yes  we have added additional NIC but that would be assigned to different VLAN/Subnet in the data center switch. How can we create EIPs from multiple Host VLANs/Subnets ?  Is there any way provided in the configuration ?

Yes we have added additional NIC but that would be assigned to different VLAN/Subnet in the data center switch. How can we create EIPs from multiple Host VLANs/Subnets ? Is there any way provided in the configuration ?

In openstack neutron, a network can have more than one subnet, but a subnet (cidr) always refer to a VLAN.
for now,  in ovn eip snat case, subnet also refer to a vlan, a provider network.
maybe neutron network|subnet could give us some ideas.

anyone has a workaround to this issue?

anyone has a workaround to this issue?

yeah， we are working on a PR for the case： multi external vlan subnets attached to a custom vpc。
you can use the feature with these steps

create an extra external subnet with （provider network，vlan subnet crd）
set the extra external subnets in the custom vpc spec extraExternalSubnets list
create ovn snat and ovn fip as you need

@bobz965 Will it also work on default vpc?

@bobz965 Will it also work on default vpc?

we will try, please wait

@bobz965 Thanks for the info. It would be a very cool feature.

@bobz965 Will it also work on default vpc?

we will try, please wait

@bobz965 any updates on this?

@bobz965 Will it also work on default vpc?

we will try, please wait

@bobz965 any updates on this?

yeah， already complete， please refer： https://kubeovn.github.io/docs/v1.13.x/en/advance/ovn-eip-fip-snat/

@bobz965 Will it also work on default vpc?

we will try, please wait

@bobz965 any updates on this?

yeah， already complete， please refer： https://kubeovn.github.io/docs/v1.13.x/en/advance/ovn-eip-fip-snat/

maybe you need to handle the default vpc route by yourself carefully. you can try custom vpc as an example.


Slow zooming performance

Repo

Open editor
cmd``+ to zoom in

Perf

Specifically the call to e._constructLines @ splitLinesCollection.ts:184 Seems to take along time. I was in the file jsDocompletionItemProvider with the workspace state:

Not sure why this one case was so slow. Subsequent measures of this function were more around ~100ms

@mjbvz I cannot reproduce in a clean (default options) VS Code.
I've extracted jsDocCompletionProvider.ts from our workspace and tried all sorts of zooming in/out and I could not get _constructLines to show up in the profiler.
From your screenshot, it appears the call stack leading to _constructLines is caused by one of the following:

the wrapping indent has changed (editor.wrappingIndent)
the wrapping column has changed (various ways this can happen, e.g. resizing the width of the editor when word wrap is on)
the ratio of fullwidth/regularwidth characters has changed (i.e. font family change)

Can you please provide additional details, for me, zooming in does not execute _constructLines

Thanks @alexandrudima. I'm going to closing this issue as I'm unable to reproduce it with the current master. I'll let you know if I start hitting this again


Bigger background

Background (svg) should be higher because of profile icon clicking (animation) - title "Stenkowa" comes over white element and becomes invisible

Fixed in #78

Refixed in #81

postponed until later in #82

fixed in #89

container border visible in #92


[Violation] 'setInterval' handler took 55ms

[Violation] 'setInterval' handler took 55ms occurs often but not every time.
Theory: I'm doing too much work in the interval function, maybe requestAnimationFrame() should not be inside an interval

Relevant code from does-it-glider/main.js:
// call apply_rules() and draw() every beat msecs
setInterval(() => {
    // apply the rules to the state
    state = apply_rules(state)
    // draw the state smoothly before next animation frame
    // requestAnimationFrame(draw.bind(null, field, state))
    // don't call requestAnimationFrame() inside setInterval() callback
    draw(field, state)
}, beat/4)


Create 2016-08-30-cloud-platform-release-notes.md

These are the release notes for 8/30/16

This one was incorrectly formatted.


Saving Models' Metadata

Issue
Problem Description
When saving a model, some information such as indices involved in training and testing should be saved in the form of the model metadata.
Expected Behavior
What Needs to be Done
How Can It Be Tested or Reproduced

I believe this can be closed?

@fazelehh can we close this?