Extension for data integrity

In a recent conversation with @balaji-gfdl, we discussed the importance of data integrity. Verifying data integrity is crucial for many data providers. For standard single-file-based formats (e.g. netcdf, hdf5, csv), the md5 checksum is the gold standard for verifying that a file is binary identical after network transmission. What best practice for data integrity will be recommend for Zarr data?
Fletcher checksums have been proposed as a possible filter / compressor option in #38. AFAIU, these would tell us whether a single chunk has been corrupted in transit. It does not address some broader questions, such as:

How do we verify that two arrays are the same (down to the bit) in a chunked Zarr store and a legacy data format?
How do we verify that two arrays with different chunk structure are the same (down to the bit)?

There is obviously an expensive way to do this: open each array in python and say np.testing.assert_array_equal. This is a lot more expensive and inconvenient than just running md5 on the command line.
It seems like this is a question that a certain type of computer scientist may already know the answer to. Some sort of hierarchical checksum, extension of the Fletcher algorithm, etc....
Whatever the technical solution, it seems essential that we have some sort of answer to this common question.

see also: https://github.com/zarr-developers/zarr-python/issues/392

Thanks for the xref! I should have checked the other issue tracker before posting...

Thanks for raising this @rabernat . It is a rather critical issue for those of us who have vast legacy data stores that we might want to bring forward.
The issue raised above by @joshmoore covers chunk level checksums, but as Ryan says, we want checksums that are identical across rechunking, and against legacy data.
For legacy data, we may want to verify array integrity and also metadata integrity. md5sum on a file guarantees both, but not separately. nccmp (https://gitlab.com/remikz/nccmp) allows you to compare data or metadata separately.
For performance, a good reference number is that a simple md5sum on a file runs at 0.5 GB/s on my laptop. An archive like CMIP6 contains maybe 10 PB of data.

I'm guessing you are already familiar with .digest() and .hexdigest().

digest/hexdigest/sha1/md5 are all (based on) cryptographic hashes, they usually trade speed for robustness, unless you are worried of an attacker actually trying  to compromise your data, you really do want to go for non-crypto hashes.
In particular you do want to know how the hash changes when only a subset of the data is modified. This is usually obtained by hashes being computed in a tree-like structure of blocks independently or computing order (but dependant on position).
For example xxHash is about 10x faster than md5. Murmurhash has also been mentioned in the other thread. One of the issues with storing the hash in the attribute file is locking, as you likely want it per-chunks. And if you want to store per-group hashes, then you also need a atomic update of the group level metadata.

All good points. It's certainly possible to extend these to other hashes as needed. I guess the first question is whether these functions are close to our intended use case here. If not, what would we want to see instead?

I just learned about homeomorphic hashing

A homomorphic hash is a construction that's simple in principle: a hash function such that you can compute the hash of a composite block from the hashes of the individual blocks.

There is also a paper about it
https://ieeexplore.ieee.org/document/1301326
https://www.cs.princeton.edu/~mfreed/docs/authcodes-sp04.pdf

I just learned about homeomorphic hashing

A homomorphic hash is a construction that's simple in principle: a hash function such that you can compute the hash of a composite block from the hashes of the individual blocks.

There is also a paper about it
https://ieeexplore.ieee.org/document/1301326
https://www.cs.princeton.edu/~mfreed/docs/authcodes-sp04.pdf

I'm guessing you are already familiar with .digest(...) and .hexdigest(...).

These don't do quite what I want:
import zarr
z1 = zarr.ones(shape=(10000, 10000), chunks=(1000, 1000))
z2 = zarr.ones(shape=(10000, 10000), chunks=(2000, 2000))
assert z1.digest() == z2.digest()  # failse

I'm looking for a hash that is independent of chunks, such that I can rechunk the array and the verify its integrity.

I'm guessing you are already familiar with .digest(...) and .hexdigest(...).

These don't do quite what I want:
import zarr
z1 = zarr.ones(shape=(10000, 10000), chunks=(1000, 1000))
z2 = zarr.ones(shape=(10000, 10000), chunks=(2000, 2000))
assert z1.digest() == z2.digest()  # failse

I'm looking for a hash that is independent of chunks, such that I can rechunk the array and the verify its integrity.

I'm just reaching this point as well, @rabernat. Did you come up with a solution?
Within trying to work this into the codec/filtering code, my current best idea is to create a secondary array which store hash sums for some chunking of the primary array. Checking those checksums may be suboptimal if a new chunking has been chosen for the primary array, but at least it'll be possible to calculate the checksums in parallel.

I will close this as a duplicate of #392.


Add non-human animal diseases from VeNom

This is a self-assigned issue I am opening to add non-human animal diseases from VeNom.
See https://venomcoding.org/venom-codes/
There are 6,182 rows of diagnosis data with disease/phenotype name, VeNom code, body system classification (if applicable), and group of animal affected (large animal, small animal, farm animal, equine, exotics).
This data will need curation as some "diagnoses" are actually "phenotypes" and should be added to uPheno.
The non-human animal diseases will be mapped to human disease analogs as appropriate.

@katiermullen could you assign this to a milestone?


[LA-316] [LA-317] Leapfrog with rpc

Previous commit included the flexible leapfrog features. This
leverages it to load our own scripts to leap RPC, and redeploy
RPC bits (currently ELK and MaaS).

@hughsaunders @odyssey4me Your comments on previous commit should be addressed here.

@evrardjp OK, just bear in mind that commit history lives beyond other systems which have details, for example JIRA. It's best to comment in the code (it's easiest to find information in context) or to describe what/why in the commit message to provide context. I do feel like the stuff being done in these commits requires more context than I have, making it difficult to do anything other than a syntax/spelling/sanity check.

@odyssey4me Fair point. I'll have to rebase, so I'll include commit message changes at the same time.

recheck_cit_swift
recheck_cit_trusty_leapfrogupgrade_swift

as you can see, the trusty-leapfrogupgrade-swift works \o/

CIT/ceph
Old job, expected to fail
CIT/leapfrogupgrade
Old job, expected to fail
CIT/swift
Old job, expected to fail
CIT/trusty-leapfrogupgrade-ceph
ceph doesn't deploy on N. This job will disappear in the future
CIT/xenial
Old job, expected to fail
CIT/xenial-leapfrogupgrade-swift
kilo doesn't deploy on xenial. This job will disappear in the future.
So everything is fine!


Parameters for Replicated Softmax

There are some parameters in replicated_softmax_layer.py: multiplicative_prior, additive_prior, adaptive_prior. Anyone knows the meaning of these parameters and how to set them?
In addition, it seems the ApplyActivation function does not follow the formula in the paper[1]. Is there any document explaining the mathematics behind the related code (e.g., how to compute p(h|v) and p(v|h) and sufficient statistics)
Thanks in advance.
[1]:Replicated Softmax: an Undirected Topic Model

You may need to review the knowlege of RBM (Restricted Boltzman Machine), in which their idea about the energy function is quite similar.


Document that Helvetica Neue can cause problems on Windows

Would also be neat to provide a JS workaround à la http://getbootstrap.com/getting-started/#support-ie10-width
Refs #13823

The issue is that a font-weight is not specified. Add that declaration (font-weight: 300) and this goes away. The default of 400 or 500 is kicking it to Helvetica Neue Bold and not Helvetica Neue Medium. Test it yourself and you'll see.


Uncomment hostname

Testing...

Already fixed here - https://github.com/agileseason/chef_rails_base/commit/ed6301465ea7f00a95c95075dace90eeca3d4b26


Rate limit reached for gpt-4

Describe the bug:
I can't switch to any gpt-4 model because aicommit exceeds the rate limits even though rate limit is set to 20RPM

Rate limit reached for gpt-4 in organization org-XXXXX on tokens per min. Limit: 10000 / min. Please try again in 6ms. Contact us through our help center at help.openai.com if you continue to have issues.

Steps to reproduce:
basic usage - rate limit set to 20rpm
Expected behavior:
not exceed 10K RPM limit?!
Additional context:

Thank you for your response. The rate limiting feature of the AICommit plugin has not been implemented yet. If you receive a similar prompt, it is directly issued by OpenAI, and the plugin only displays the error message.

then why expose the rate limit control to the user?

I apologize for the inconvenience. The feature was initially working fine until OpenAI made some changes to the rate limits. In order to quickly fix the issue, we removed the internal implementation while still leaving the UI visible. We will release an update within a few days which will hide the control for now. We will prioritize re-implementing the feature and make it available again in the future. Thank you.

thank you kindly for the background on the issue.  I was initially confused by the rate limit control + the rate limit reached error.

Thank you for understanding, UI issue would be fixed soon. Have a nice day :)

@rosuH @GonzRon
i'm the maintainer of LiteLLM we allow you to maximize your throughput/increase rate limits -  load balance between multiple deployments (Azure, OpenAI)
I believe litellm can be helpful here - and i'd love your feedback if we're missing something
Here's how to use it
Docs: https://docs.litellm.ai/docs/routing
from litellm import Router

model_list = [{ # list of model deployments
    "model_name": "gpt-3.5-turbo", # model alias
    "litellm_params": { # params for litellm completion/embedding call
        "model": "azure/chatgpt-v-2", # actual model name
        "api_key": os.getenv("AZURE_API_KEY"),
        "api_version": os.getenv("AZURE_API_VERSION"),
        "api_base": os.getenv("AZURE_API_BASE")
    }
}, {
    "model_name": "gpt-3.5-turbo",
    "litellm_params": { # params for litellm completion/embedding call
        "model": "azure/chatgpt-functioncalling",
        "api_key": os.getenv("AZURE_API_KEY"),
        "api_version": os.getenv("AZURE_API_VERSION"),
        "api_base": os.getenv("AZURE_API_BASE")
    }
}, {
    "model_name": "gpt-3.5-turbo",
    "litellm_params": { # params for litellm completion/embedding call
        "model": "vllm/TheBloke/Marcoroni-70B-v1-AWQ",
        "api_key": os.getenv("OPENAI_API_KEY"),
    }
}]

router = Router(model_list=model_list)

# openai.ChatCompletion.create replacement
response = router.completion(model="gpt-3.5-turbo",
                messages=[{"role": "user", "content": "Hey, how's it going?"}])

print(response)


Customerprovider pipeline2[DONOT MERGE]

MSFT employees can try out our new experience at OpenAPI Hub  - one location for using our validation tools and finding your workflow.

Contribution checklist:

[ ] I have reviewed the documentation for the workflow.
[ ] Validation tools were run on swagger spec(s) and have all been fixed in this PR. How to fix?

If any further question about AME onboarding or validation tools, please view the FAQ.
ARM API Review Checklist

[ ] Service team MUST add the "WaitForARMFeedback" label if the management plane API changes fall into one of the below categories.

adding/removing APIs.
adding/removing properties.
adding/removing API-version.
adding a new service in Azure.

Failure to comply may result in delays for manifest application. Note this does not apply to data plane APIs.

[ ] If you are blocked on ARM review and want to get the PR merged urgently, please get the ARM oncall for reviews (RP Manifest Approvers team under Azure Resource Manager service) from IcM and reach out to them.
Please follow the link to find more details on API review process.

/azp run automation - sdk

Can one of the admins verify this patch?

/azp run automation - sdk

/azp run automation - sdk

azure-sdk-for-trenton⌛ Pending...

azure-sdk-for-trenton⌛ Pending...

azure-sdk-for-trenton⌛ Pending...

/azp run automation - sdk

/azp run automation - sdk

azure-sdk-for-trenton - Release⌛ Pending...

azure-sdk-for-trenton - Release⌛ Pending...


Legion: default mapper disregards field constraints for region requirements with reduction privileges

The attached C++ program, which tries to impose a field constraint on region requirements with reduction instances, shows that the default mapper disregards the field constraint.
If line 243 is commented out, the program works fine
constraintTest2.tar.gz
@elliottslaughter, can you please add this issue to #1032?

Upon further investigation, it appears that the problem is here https://gitlab.com/StanfordLegion/legion/-/blob/master/runtime/mappers/default_mapper.cc#L2030-2031
@streichler @lightsighter, is it still necessary to have one field per reduction instance?

There shouldn't be anything that prevents you from making a reduction instance with multiple fields.

In that case, the following patch should fix the issue.
diff --git a/runtime/mappers/default_mapper.cc b/runtime/mappers/default_mapper.cc
index 7a5d77adb9..8e83aba967 100644
--- a/runtime/mappers/default_mapper.cc
+++ b/runtime/mappers/default_mapper.cc
@@ -2022,36 +2022,9 @@ namespace Legion {
                           size_t *footprint /*= NULL*/)
     //--------------------------------------------------------------------------
     {
-      // Special case for reduction instances, no point in checking
-      // for existing ones and we also know that currently we can only
-      // make a single instance for each field of a reduction
-      if (req.privilege == LEGION_REDUCE)
-      {
-        // Iterate over the fields one by one for now, once Realm figures
-        // out how to deal with reduction instances that contain
-        bool force_new_instances = true; // always have to force new instances
-        LayoutConstraintID our_layout_id =
-         default_policy_select_layout_constraints(ctx, target_memory, req,
-               TASK_MAPPING, needs_field_constraint_check, force_new_instances);
-        LayoutConstraintSet our_constraints =
-                      runtime->find_layout_constraints(ctx, our_layout_id);
-        instances.resize(instances.size() + req.privilege_fields.size());
-        unsigned idx = 0;
-        for (auto it =
-              req.privilege_fields.begin(); it !=
-              req.privilege_fields.end(); it++, idx++)
-        {
-          our_constraints.field_constraint.field_set.clear();
-          our_constraints.field_constraint.field_set.push_back(*it);
-          if (!default_make_instance(ctx, target_memory, our_constraints,
-                       instances[idx], TASK_MAPPING, force_new_instances,
-                       true/*meets*/, req, footprint))
-            return false;
-        }
-        return true;
-      }
+      // Special case for reduction instances, always have to force new instances
+      bool force_new_instances = (req.privilege == LEGION_REDUCE);

-      bool force_new_instances = false;
       // preprocess all the task constraint sets
       // partition them into field/non-field constraint sets + fields
       std::vector<std::vector<FieldID> > field_arrays, leftover_fields;

(Please double check that there aren't any side effects)

In that case, the following patch should fix the issue.
diff --git a/runtime/mappers/default_mapper.cc b/runtime/mappers/default_mapper.cc
index 7a5d77adb9..8e83aba967 100644
--- a/runtime/mappers/default_mapper.cc
+++ b/runtime/mappers/default_mapper.cc
@@ -2022,36 +2022,9 @@ namespace Legion {
                           size_t *footprint /*= NULL*/)
     //--------------------------------------------------------------------------
     {
-      // Special case for reduction instances, no point in checking
-      // for existing ones and we also know that currently we can only
-      // make a single instance for each field of a reduction
-      if (req.privilege == LEGION_REDUCE)
-      {
-        // Iterate over the fields one by one for now, once Realm figures
-        // out how to deal with reduction instances that contain
-        bool force_new_instances = true; // always have to force new instances
-        LayoutConstraintID our_layout_id =
-         default_policy_select_layout_constraints(ctx, target_memory, req,
-               TASK_MAPPING, needs_field_constraint_check, force_new_instances);
-        LayoutConstraintSet our_constraints =
-                      runtime->find_layout_constraints(ctx, our_layout_id);
-        instances.resize(instances.size() + req.privilege_fields.size());
-        unsigned idx = 0;
-        for (auto it =
-              req.privilege_fields.begin(); it !=
-              req.privilege_fields.end(); it++, idx++)
-        {
-          our_constraints.field_constraint.field_set.clear();
-          our_constraints.field_constraint.field_set.push_back(*it);
-          if (!default_make_instance(ctx, target_memory, our_constraints,
-                       instances[idx], TASK_MAPPING, force_new_instances,
-                       true/*meets*/, req, footprint))
-            return false;
-        }
-        return true;
-      }
+      // Special case for reduction instances, always have to force new instances
+      bool force_new_instances = (req.privilege == LEGION_REDUCE);

-      bool force_new_instances = false;
       // preprocess all the task constraint sets
       // partition them into field/non-field constraint sets + fields
       std::vector<std::vector<FieldID> > field_arrays, leftover_fields;

(Please double check that there aren't any side effects)
With the above changes the mapper will give precedence to specialized constraints in task layout constraints. i.e. it will ignore/override the 'redop' field in the region requirement (no error checking in the mapper for mismatch).
The current behavior (master) always defaults to whatever is set in region requirement (redop field).
@lightsighter - I can add error checking in the mapper for mismatch and is the above new behavior ok? Are there any layout constraints that are not applicable to region requirements with reduction privileges? Does the 'force_new_instances' field need to be set to true above?

I can add error checking in the mapper for mismatch and is the above new behavior ok?
Does the 'force_new_instances' field need to be set to true above?

I don't think we actually want this patch because this forces the creation of a new instance creation for every reduction region requirement, which is sub-optimal. I didn't do a bunch of hard work to allow for reuse of reduction instances for nothing. 😉 The default mapper should be able to do the check to see if it can reuse reduction instances the same as for normal instances. If there are conflicts you can pick it up that way too. Do you agree that should handle the mismatch case you were thinking about?

Are there any layout constraints that are not applicable to region requirements with reduction privileges?

A reduction instance is the same as a normal instance with two exceptions:

The size of the fields used will correspond to the size of the RHS type of the reduction operator instead of the LHS (normal field size).
Legion will automatically initialize reduction instances on their first (re-)use with the identity value of the reduction operator.

Other than that, all the normal layout constraints still apply and can be used to describe reduction instances.
I'm not sure I completely answered your questions so ask again if I missed something.

I don't think we actually want this patch because this forces the creation of a new instance creation for every reduction region requirement, which is sub-optimal.

Note that the current version of the default mapper currently sets the force_new_instances variable to true for all reduction instances
https://gitlab.com/StanfordLegion/legion/-/blob/master/runtime/mappers/default_mapper.cc#L2032 . Interestilgly, profiles extracted with HTR show that the reduction instances are reused if the same task is launched multiple times in succession.

Note that the current version of the default mapper currently sets the force_new_instances variable to true for all reduction instances

Yes, that should be fixed.

Interestilgly, profiles extracted with HTR show that the reduction instances are reused if the same task is launched multiple times in succession.

Right, because the default mapper is allowed to memoize the mappings of those tasks even if they have reduction-only region requirements now and replay them later so you don't even have to go through the path of calling default_make_instance.

There's a PR for this and issue  #1705 overlaps with it -  reduc/default mapper (WIP)

https://gitlab.com/StanfordLegion/legion/-/merge_requests/1337 has been merged into master

Can we close this now?


TypeScript Intellisense shows incorrect function signature

Issue Type: Bug
function add(num1: number, num2: number): number {
  return num1 + num2;
}

after writing the function above and then trying to call it, intellsense shows
add(num1: any, num2: any): any as its first suggestion
You have to go to the second suggestion to see the correct suggestion: add(num1: number, num2: number): number.
It should only display the latter suggestion
Here's a visual

VS Code version: Code 1.32.3 (a3db5be9b5c6ba46bb7555ec5d60178ecc2eaae4, 2019-03-14T22:46:48.547Z)
OS version: Darwin x64 18.2.0

System Info

Item
Value

CPUs
Intel(R) Core(TM) i7-8750H CPU @ 2.20GHz (12 x 2200)

GPU Status
2d_canvas: enabledchecker_imaging: disabled_offflash_3d: enabledflash_stage3d: enabledflash_stage3d_baseline: enabledgpu_compositing: enabledmultiple_raster_threads: enabled_onnative_gpu_memory_buffers: enabledrasterization: enabledsurface_synchronization: enabled_onvideo_decode: enabledwebgl: enabledwebgl2: enabled

Load (avg)
2, 2, 2

Memory (System)
16.00GB (0.38GB free)

Process Argv
-psn_0_893146

Screen Reader
no

VM
0%

Extensions (11)

Extension
Author (truncated)
Version

vscode-eslint
dba
1.8.2

prettier-vscode
esb
1.8.1

vscode-pull-request-github
Git
0.5.1

chat
kar
0.12.0

python
ms-
2019.3.6215

sublime-keybindings
ms-
4.0.0

vsliveshare
ms-
0.3.1403

vsliveshare-audio
ms-
0.1.48

vsliveshare-pack
ms-
0.2.10

vscode-docker
Pet
0.6.1

vscode-todo-highlight
way
1.0.4

Closing and reopening the file made the error go away, but definitely something going on there

You have opened both the js and ts version of the file. Since these files do not have any imports or exports, everything declared in them is considered global. Therefore it will see both the ts declaration of add plus the compiled js version of add
Try creating a simple tsconfig to ensure that the ts file is treated as part of its own project


Added tab switching code in Selenium.

Can i add tab switch feature of Selenium in  Java.

why not

Thanks.


feat(tpu): add  tpu queued resources create/delete/force delete/get/list samples

Description
Issue with Deleting operation in google.cloud.tpu_v2alpha1

When running on macOS, the user will encounter an IllegalStateException, which is better handled at the library level and not delegated to the user, as it does not affect the delete method, since it is successful.

2.We are using the v2alpha1 library to delete Queued Resources and we faced an issue with the unpack operation even though it still succeeds. I have handled this in a catch block, but I believe that this is not a very good way to pass this exception to the end user.

Log file -  log.txt
Fixes #
Note: Before submitting a pull request, please open an issue for discussion if you are not associated with Google.
Checklist

[x] I have followed Sample Format Guide
[ ] pom.xml parent set to latest shared-configuration
[ ] Appropriate changes to README are included in PR
[ ] These samples need a new API enabled in testing projects to pass (let us know which ones)
[ ] These samples need a new/updated env vars in testing projects set to pass (let us know which ones)
[x] Tests pass:   mvn clean verify required
[x] Lint  passes: mvn -P lint checkstyle:check required
[ ] Static Analysis:  mvn -P lint clean compile pmd:cpd-check spotbugs:check advisory only
[ ] This sample adds a new sample directory, and I updated the CODEOWNERS file with the codeowners for this sample
[ ] This sample adds a new Product API, and I updated the Blunderbuss issue/PR auto-assigner with the codeowners for this sample
[ ] Please merge this PR for me once it is approved

Will be merged after https://github.com/GoogleCloudPlatform/java-docs-samples/pull/9585


hard-coded folder name

the folder name of 'src' has been hard-coded in this object:
  info = {
      path: root.replace(path.join(process.cwd(),'src/'), ''),
      name: path.basename(root).replace(/^\d./, ''),
      slug: path.basename(root)
  };

By mistake created the issue here :(
The issue suppose to be created in gulp tree.


Support Git on Azure Devops Server

Is your feature request related to a problem? Please describe.
We areworking on closed environment (no internet) and want to use the frogbot on our azure devops 2020 on premise that would connect to our on-premise Jfrog server (xray+artifactory)
Describe the solution you'd like to see
add azure devops git to the guthub\gitlab\bitbucket options
Describe alternatives you've considered

+1 for onprem Azure DevOps Server + JFrog onprem.

That's great! Can we deploy to Azure DevOps server?

Frogbot with Support for scanning Azure Repos is now available. See the documentation for installation and usage details
@Jan-Pleva - Frogbot doesn't perform deployments. It scans your repositories and pull requests for security vulnerabilities.

Hello, I have tested it on our on prem instance of Azure DevOps server, however, there seems to be places in the code with the Hardcorded URL of Azure DevOps Cloud:
`
15:03:21 [Info] Xray scan completed
15:03:21 [Debug] Upload Scan to Azure Repos is currently unsupported.
15:03:21 [Info] Found 3 vulnerable dependencies with fix versions
15:03:21 [Debug] Created temp working directory: /tmp/jfrog.cli.temp.-1674655401-4193977151
15:03:51 [Error] repository (REDACTED) returned the following error:
'git clone master from https://(REDACTED)@dev.azure.com/(REDACTED)/(REDACTED)/_git/(REDACTED)' failed with error: Get "https://(REDACTED)@dev.azure.com/(REDACTED)/(REDACTED)/_git/(REDACTED)/info/refs?service=git-upload-pack": dial tcp <IP_ADDRESS>:443: i/o timeout
`

Thank you for reporting this, @anael-l. I'm investigating it and will update as soon as possible.

Hi @anael-l, do you use Azure Repos?
According to Microsoft's documentation, Azure Repos Clone URLs contain "dev.azure.com", as you can see here here ("Get the clone URL of an Azure Repos Git repo" -> 3rd picture).
Did we miss anything? Thanks!

Hi @omerzi, yes you've got the right doc, but I don't think Microsoft made an effort to change the doc for the Server version, as it's exactly the same for the cloud version on this page...
On our instance, the repo URL constructed like this :
https://[custom-domain]/[collection]/[team-project/_git/[repo]
The weird thing is that the first clone froggit does using the API works :
15:01:05 [Info] Running Frogbot "scan-and-fix-repos" command  15:01:05 [Debug] Usage Report: Sending info... 15:01:05 [Debug] Created temp working directory:  /tmp/jfrog.cli.temp.-1674655265-4257864351 15:01:05 [Debug] Downloading (Collection)/(RepoName), branch: master to: /tmp/jfrog.cli.temp.-1674655265-4257864351 15:01:05 [Debug] download url: https://(CustomDomain)/(Collection)/(TeamProject)/_apis/git/repositories/(RepoName)/items/items?path=/&versionDescriptor[version]=master&$format=zip 15:01:05 [Debug] Sending HTTP GET request to: https://(artifactorydns)/artifactory/api/system/version 15:01:05 [Debug] Artifactory response: 200  [...]
I think you should use the environment variable JF_GIT_API_ENDPOINT as it might be the case for the clone using the API

Thanks, @anael-l for clarifying that. So just to be clear, when you need to clone using the git command line, as it's the command that fails on frogbot, the command looks something like this:
git clone https://[custom-domain]/[collection]/[team-project]/_git/[repo]
Or like this:
git clone https://[collection]@[custom-domain]/[collection]/[project]/_git/[repo]

I've always used the first one
git clone https://[custom-domain]/[collection]/[team-project]/_git/[repo]
As it is the one provided in the Clone Repository popup as shown in the Microsoft documentation.
However out of curiosity I tested the second one, and it also seems to work.

My sincere thanks go out to you for your assistance. I have opened a Pull Request with the following changes:
https://github.com/jfrog/froggit-go/pull/65
I'll update once Frogbot is released with the updated froggit-go dependency.

Thank you for the fast anwsers and fix !
I will test it once it is available

@anael-l, v2.5.5 is released. Please let me know if it works, thank you!

It works ! Thank you very much !
16:35:14 [Info] Frogbot "scan-and-fix-repos" command finished successfully


Contributing guideline improvements

Adds pull request template (which, ironically, I am not following at all here)
Minor cleanup for CONTRIBUTING.md file

:tada: This PR is included in version 6.6.2 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


Bevy should supply types and patterns for interpolating transforms with fixed timesteps

What problem does this solve or what need does it fill?
When working with fixed time, the correct pattern is to mutate "gameplay position" data, then interpolate the rendered transform based on the elapsed time.
Bevy does not currently (0.14) do this by default, and does not provide the tools or learning material to do this either.
What solution would you like?

Bevy introduces a trait for gameplay transforms.
Bevy provides a generic system to interpolate positions correctly that requires this trait.
A generic plugin is provided to add this plugin in the correct spot in the schedule.
Most of our examples are moved off fixed time, but a new example and new game are added to demonstrate this pattern.

What alternative(s) have you considered?
We could add our own gameplay transform type(s), but the exact needs will vary quite a bit between game types. I think the trait is probably the right interface.
Additional context
This was raised by Otoya and explained by @inodentry here.
https://github.com/bevyengine/bevy/issues/13306 proposes related functionality for checking simulation time.

https://github.com/bevyengine/bevy/issues/1259 previously proposed this. Closing in favor of that issue.


fails to compute attribute derived from component selection

ref: this jsfiddle https://jsfiddle.net/cmgjz9z4/1/
Previously posted on StackOverflow (http://stackoverflow.com/questions/34385694/fails-to-compute-attribute-derived-from-components-collection), where a respondent suggested this might be a bug. So re-posted here.
given the following coffeescript:
Member = Ractive.extend
  template : "<p>{{name}} {{age}}</p>"
  computed :
    age : ->
      parseInt(@get('age_in_days')/365)

new Ractive
  el : "#family"
  template : "{{#members}}<member name='{{name}}' age_in_days='{{age_in_days}}'/>{{/members}}{{youngest}}"
  components :
    member : Member
  data:
    members : [
      {name : 'Fred', age_in_days: 8000},
      {name : 'Barney', age_in_days: 10000},
      {name : 'Wilma', age_in_days: 7000}
      ]
  computed :
    all_ages : ->
      _(@findAllComponents('member')).map (member)->
        member.get('age')
    youngest : ->
      _(@get('all_ages')).min()

An error is thrown ("TypeError: Cannot read property 'findAllComponents' of undefined") from deep within the Ractive code. And the computed attributes "all_ages" and "youngest" are not computed or rendered.
I believe this to be a legitimate scenario consistent with the docs. So I'm assuming that the error is the symptom of a bug.

Computed properties are as part of data initialization which happens prior to virtual dom creation or rendering, so there are no components to find.
There's not really a great way in Ractive to use a computed property in a component as a data generator.
You could delay the getting of the components using something like this: https://jsfiddle.net/cmgjz9z4/3/

Ah, I see, that clarifies a lot of issues I've had with computed properties. Thanks Marty!

Ah, I see, that clarifies a lot of issues I've had with computed properties. Thanks Marty!


Fix prefixes for OBO:[external resource]

This is more of an issue for kg-bioportal, but it can be addressed here.
Some CURIES contain pound signs (no, I will not call them hash signs, etc etc), e.g. in PR:
OBO:EnsemblBacteria#_BruAb1_2100

or
OBO:dictyBase#_DDB_G0276875

This only becomes an issue once we hit the cat-merge step in kg-bioportal, at which point everything after the # is truncated, leaving redundant-looking CURIEs like OBO:dictyBase. That's not really a bug, and it can be fixed by assigning the specific prefixes for these cases.

This is a problem with PR in particular.


Dashboard crashes after 1min timout when incorrectly defining the OLTP endpoint on the same port as the Dashboard

launchSettings.json
{
  "$schema": "http://json.schemastore.org/launchsettings.json",
  "profiles": {
    "http": {
      "commandName": "Project",
      "dotnetRunMessages": true,
      "launchBrowser": true,
      "applicationUrl": "http://<IP_ADDRESS>:9050",  //<---
      "environmentVariables": {
        "ASPNETCORE_ENVIRONMENT": "Development",
        "DOTNET_ENVIRONMENT": "Development",
        "DOTNET_DASHBOARD_OTLP_ENDPOINT_URL": "http://<IP_ADDRESS>:9050"  //<---
      }
    }
  }
}

Exception:
fail: Microsoft.Extensions.Hosting.Internal.Host[11]
      Hosting failed to start
      Aspire.Hosting.DistributedApplicationException: Timed out after 00:01:00 while waiting for the dashboard to be responsive.
         at Aspire.Hosting.Dcp.HttpPingDashboardAvailability.WaitForDashboardAvailabilityAsync(Uri url, TimeSpan timeout, CancellationToken cancellationToken) in /_/src/Aspire.Hosting/Dcp/HttpPingDashboardAvailability.cs:line 50
         at Aspire.Hosting.Dcp.ApplicationExecutor.CheckDashboardAvailabilityAsync(String delimitedUrlList, CancellationToken cancellationToken) in /_/src/Aspire.Hosting/Dcp/ApplicationExecutor.cs:line 241
         at Aspire.Hosting.Dcp.ApplicationExecutor.StartDashboardAsDcpExecutableAsync(CancellationToken cancellationToken) in /_/src/Aspire.Hosting/Dcp/ApplicationExecutor.cs:line 217
         at Aspire.Hosting.Dcp.ApplicationExecutor.RunApplicationAsync(CancellationToken cancellationToken) in /_/src/Aspire.Hosting/Dcp/ApplicationExecutor.cs:line 86
         at Aspire.Hosting.Dcp.DcpHostService.StartAsync(CancellationToken cancellationToken) in /_/src/Aspire.Hosting/Dcp/DcpHostService.cs:line 68
         at Microsoft.Extensions.Hosting.Internal.Host.<StartAsync>b__15_1(IHostedService service, CancellationToken token)
         at Microsoft.Extensions.Hosting.Internal.Host.ForeachService[T](IEnumerable`1 services, CancellationToken token, Boolean concurrent, Boolean abortOnFirstException, List`1 exceptions, Func`3 operation)
Unhandled exception. System.AggregateException: One or more errors occurred. (Timed out after 00:01:00 while waiting for the dashboard to be responsive.)
 ---> Aspire.Hosting.DistributedApplicationException: Timed out after 00:01:00 while waiting for the dashboard to be responsive.
   at Aspire.Hosting.Dcp.HttpPingDashboardAvailability.WaitForDashboardAvailabilityAsync(Uri url, TimeSpan timeout, CancellationToken cancellationToken) in /_/src/Aspire.Hosting/Dcp/HttpPingDashboardAvailability.cs:line 50
   at Aspire.Hosting.Dcp.ApplicationExecutor.CheckDashboardAvailabilityAsync(String delimitedUrlList, CancellationToken cancellationToken) in /_/src/Aspire.Hosting/Dcp/ApplicationExecutor.cs:line 241
   at Aspire.Hosting.Dcp.ApplicationExecutor.StartDashboardAsDcpExecutableAsync(CancellationToken cancellationToken) in /_/src/Aspire.Hosting/Dcp/ApplicationExecutor.cs:line 217
   at Aspire.Hosting.Dcp.ApplicationExecutor.RunApplicationAsync(CancellationToken cancellationToken) in /_/src/Aspire.Hosting/Dcp/ApplicationExecutor.cs:line 86
   at Aspire.Hosting.Dcp.DcpHostService.StartAsync(CancellationToken cancellationToken) in /_/src/Aspire.Hosting/Dcp/DcpHostService.cs:line 68
   at Microsoft.Extensions.Hosting.Internal.Host.<StartAsync>b__15_1(IHostedService service, CancellationToken token)
   at Microsoft.Extensions.Hosting.Internal.Host.ForeachService[T](IEnumerable`1 services, CancellationToken token, Boolean concurrent, Boolean abortOnFirstException, List`1 exceptions, Func`3 operation)
   at Microsoft.Extensions.Hosting.Internal.Host.StartAsync(CancellationToken cancellationToken)
   at Microsoft.Extensions.Hosting.HostingAbstractionsHostExtensions.RunAsync(IHost host, CancellationToken token)
   at Microsoft.Extensions.Hosting.HostingAbstractionsHostExtensions.RunAsync(IHost host, CancellationToken token)
   at Aspire.Hosting.DistributedApplication.RunAsync(CancellationToken cancellationToken) in /_/src/Aspire.Hosting/DistributedApplication.cs:line 133
   --- End of inner exception stack trace ---
   at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions)
   at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken)
   at System.Threading.Tasks.Task.Wait()
   at Aspire.Hosting.DistributedApplication.Run() in /_/src/Aspire.Hosting/DistributedApplication.cs:line 141

And a bunch of related extra stacktraces i found in the Win Event Viewer
 Category: Microsoft.Extensions.Hosting.Internal.Host
EventId: 11

Hosting failed to start

Exception:
System.IO.IOException: Failed to bind to address http://<IP_ADDRESS>:9050: address already in use.
 ---> Microsoft.AspNetCore.Connections.AddressInUseException: Only one usage of each socket address (protocol/network address/port) is normally permitted.
 ---> System.Net.Sockets.SocketException (10048): Only one usage of each socket address (protocol/network address/port) is normally permitted.
   at System.Net.Sockets.Socket.UpdateStatusAfterSocketErrorAndThrowException(SocketError error, Boolean disconnectOnFailure, String callerName)
   at System.Net.Sockets.Socket.DoBind(EndPoint endPointSnapshot, SocketAddress socketAddress)
   at System.Net.Sockets.Socket.Bind(EndPoint localEP)
   at Microsoft.AspNetCore.Server.Kestrel.Transport.Sockets.SocketTransportOptions.CreateDefaultBoundListenSocket(EndPoint endpoint)
   at Microsoft.AspNetCore.Server.Kestrel.Transport.Sockets.SocketConnectionListener.Bind()
   --- End of inner exception stack trace ---
   at Microsoft.AspNetCore.Server.Kestrel.Transport.Sockets.SocketConnectionListener.Bind()
   at Microsoft.AspNetCore.Server.Kestrel.Transport.Sockets.SocketTransportFactory.BindAsync(EndPoint endpoint, CancellationToken cancellationToken)
   at Microsoft.AspNetCore.Server.Kestrel.Core.Internal.Infrastructure.TransportManager.BindAsync(EndPoint endPoint, ConnectionDelegate connectionDelegate, EndpointConfig endpointConfig, CancellationToken cancellationToken)
   at Microsoft.AspNetCore.Server.Kestrel.Core.KestrelServerImpl.<>c__DisplayClass28_0`1.<<StartAsync>g__OnBind|0>d.MoveNext()
--- End of stack trace from previous location ---
   at Microsoft.AspNetCore.Server.Kestrel.Core.Internal.AddressBinder.BindEndpointAsync(ListenOptions endpoint, AddressBindContext context, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at Microsoft.AspNetCore.Server.Kestrel.Core.Internal.AddressBinder.BindEndpointAsync(ListenOptions endpoint, AddressBindContext context, CancellationToken cancellationToken)
   at Microsoft.AspNetCore.Server.Kestrel.Core.ListenOptions.BindAsync(AddressBindContext context, CancellationToken cancellationToken)
   at Microsoft.AspNetCore.Server.Kestrel.Core.Internal.AddressBinder.EndpointsStrategy.BindAsync(AddressBindContext context, CancellationToken cancellationToken)
   at Microsoft.AspNetCore.Server.Kestrel.Core.Internal.AddressBinder.BindAsync(ListenOptions[] listenOptions, AddressBindContext context, Func`2 useHttps, CancellationToken cancellationToken)
   at Microsoft.AspNetCore.Server.Kestrel.Core.KestrelServerImpl.BindAsync(CancellationToken cancellationToken)
   at Microsoft.AspNetCore.Server.Kestrel.Core.KestrelServerImpl.StartAsync[TContext](IHttpApplication`1 application, CancellationToken cancellationToken)
   at Microsoft.AspNetCore.Hosting.GenericWebHostService.StartAsync(CancellationToken cancellationToken)
   at Microsoft.Extensions.Hosting.Internal.Host.<StartAsync>b__15_1(IHostedService service, CancellationToken token)
   at Microsoft.Extensions.Hosting.Internal.Host.ForeachService[T](IEnumerable`1 services, CancellationToken token, Boolean concurrent, Boolean abortOnFirstException, List`1 exceptions, Func`3 operation)

Application: Aspire.Dashboard.exe
CoreCLR Version: 8.0.324.11423
.NET Version: 8.0.3
Description: The process was terminated due to an unhandled exception.
Exception Info: System.IO.IOException: Failed to bind to address http://<IP_ADDRESS>:9050: address already in use.
 ---> Microsoft.AspNetCore.Connections.AddressInUseException: Only one usage of each socket address (protocol/network address/port) is normally permitted.
 ---> System.Net.Sockets.SocketException (10048): Only one usage of each socket address (protocol/network address/port) is normally permitted.
   at System.Net.Sockets.Socket.UpdateStatusAfterSocketErrorAndThrowException(SocketError error, Boolean disconnectOnFailure, String callerName)
   at System.Net.Sockets.Socket.DoBind(EndPoint endPointSnapshot, SocketAddress socketAddress)
   at System.Net.Sockets.Socket.Bind(EndPoint localEP)
   at Microsoft.AspNetCore.Server.Kestrel.Transport.Sockets.SocketTransportOptions.CreateDefaultBoundListenSocket(EndPoint endpoint)
   at Microsoft.AspNetCore.Server.Kestrel.Transport.Sockets.SocketConnectionListener.Bind()
   --- End of inner exception stack trace ---
   at Microsoft.AspNetCore.Server.Kestrel.Transport.Sockets.SocketConnectionListener.Bind()
   at Microsoft.AspNetCore.Server.Kestrel.Transport.Sockets.SocketTransportFactory.BindAsync(EndPoint endpoint, CancellationToken cancellationToken)
   at Microsoft.AspNetCore.Server.Kestrel.Core.Internal.Infrastructure.TransportManager.BindAsync(EndPoint endPoint, ConnectionDelegate connectionDelegate, EndpointConfig endpointConfig, CancellationToken cancellationToken)
   at Microsoft.AspNetCore.Server.Kestrel.Core.KestrelServerImpl.<>c__DisplayClass28_0`1.<<StartAsync>g__OnBind|0>d.MoveNext()
--- End of stack trace from previous location ---
   at Microsoft.AspNetCore.Server.Kestrel.Core.Internal.AddressBinder.BindEndpointAsync(ListenOptions endpoint, AddressBindContext context, CancellationToken cancellationToken)
   --- End of inner exception stack trace ---
   at Microsoft.AspNetCore.Server.Kestrel.Core.Internal.AddressBinder.BindEndpointAsync(ListenOptions endpoint, AddressBindContext context, CancellationToken cancellationToken)
   at Microsoft.AspNetCore.Server.Kestrel.Core.ListenOptions.BindAsync(AddressBindContext context, CancellationToken cancellationToken)
   at Microsoft.AspNetCore.Server.Kestrel.Core.Internal.AddressBinder.EndpointsStrategy.BindAsync(AddressBindContext context, CancellationToken cancellationToken)
   at Microsoft.AspNetCore.Server.Kestrel.Core.Internal.AddressBinder.BindAsync(ListenOptions[] listenOptions, AddressBindContext context, Func`2 useHttps, CancellationToken cancellationToken)
   at Microsoft.AspNetCore.Server.Kestrel.Core.KestrelServerImpl.BindAsync(CancellationToken cancellationToken)
   at Microsoft.AspNetCore.Server.Kestrel.Core.KestrelServerImpl.StartAsync[TContext](IHttpApplication`1 application, CancellationToken cancellationToken)
   at Microsoft.AspNetCore.Hosting.GenericWebHostService.StartAsync(CancellationToken cancellationToken)
   at Microsoft.Extensions.Hosting.Internal.Host.<StartAsync>b__15_1(IHostedService service, CancellationToken token)
   at Microsoft.Extensions.Hosting.Internal.Host.ForeachService[T](IEnumerable`1 services, CancellationToken token, Boolean concurrent, Boolean abortOnFirstException, List`1 exceptions, Func`3 operation)
   at Microsoft.Extensions.Hosting.Internal.Host.StartAsync(CancellationToken cancellationToken)
   at Microsoft.Extensions.Hosting.HostingAbstractionsHostExtensions.RunAsync(IHost host, CancellationToken token)
   at Microsoft.Extensions.Hosting.HostingAbstractionsHostExtensions.RunAsync(IHost host, CancellationToken token)
   at Microsoft.Extensions.Hosting.HostingAbstractionsHostExtensions.Run(IHost host)
   at Aspire.Dashboard.DashboardWebApplication.Run() in /_/src/Aspire.Dashboard/DashboardWebApplication.cs:line 205
   at Program.<Main>$(String[] args) in /_/src/Aspire.Dashboard/Program.cs:line 7

Category: Microsoft.Extensions.Hosting.Internal.Host
EventId: 11

Hosting failed to start

Exception:
Aspire.Hosting.DistributedApplicationException: Timed out after 00:01:00 while waiting for the dashboard to be responsive.
   at Aspire.Hosting.Dcp.HttpPingDashboardAvailability.WaitForDashboardAvailabilityAsync(Uri url, TimeSpan timeout, CancellationToken cancellationToken) in /_/src/Aspire.Hosting/Dcp/HttpPingDashboardAvailability.cs:line 50
   at Aspire.Hosting.Dcp.ApplicationExecutor.CheckDashboardAvailabilityAsync(String delimitedUrlList, CancellationToken cancellationToken) in /_/src/Aspire.Hosting/Dcp/ApplicationExecutor.cs:line 241
   at Aspire.Hosting.Dcp.ApplicationExecutor.StartDashboardAsDcpExecutableAsync(CancellationToken cancellationToken) in /_/src/Aspire.Hosting/Dcp/ApplicationExecutor.cs:line 217
   at Aspire.Hosting.Dcp.ApplicationExecutor.RunApplicationAsync(CancellationToken cancellationToken) in /_/src/Aspire.Hosting/Dcp/ApplicationExecutor.cs:line 86
   at Aspire.Hosting.Dcp.DcpHostService.StartAsync(CancellationToken cancellationToken) in /_/src/Aspire.Hosting/Dcp/DcpHostService.cs:line 68
   at Microsoft.Extensions.Hosting.Internal.Host.<StartAsync>b__15_1(IHostedService service, CancellationToken token)
   at Microsoft.Extensions.Hosting.Internal.Host.ForeachService[T](IEnumerable`1 services, CancellationToken token, Boolean concurrent, Boolean abortOnFirstException, List`1 exceptions, Func`3 operation)

Application: Aspire.AppHost.exe
CoreCLR Version: 8.0.324.11423
.NET Version: 8.0.3
Description: The process was terminated due to an unhandled exception.
Exception Info: System.AggregateException: One or more errors occurred. (Timed out after 00:01:00 while waiting for the dashboard to be responsive.)
 ---> Aspire.Hosting.DistributedApplicationException: Timed out after 00:01:00 while waiting for the dashboard to be responsive.
   at Aspire.Hosting.Dcp.HttpPingDashboardAvailability.WaitForDashboardAvailabilityAsync(Uri url, TimeSpan timeout, CancellationToken cancellationToken) in /_/src/Aspire.Hosting/Dcp/HttpPingDashboardAvailability.cs:line 50
   at Aspire.Hosting.Dcp.ApplicationExecutor.CheckDashboardAvailabilityAsync(String delimitedUrlList, CancellationToken cancellationToken) in /_/src/Aspire.Hosting/Dcp/ApplicationExecutor.cs:line 241
   at Aspire.Hosting.Dcp.ApplicationExecutor.StartDashboardAsDcpExecutableAsync(CancellationToken cancellationToken) in /_/src/Aspire.Hosting/Dcp/ApplicationExecutor.cs:line 217
   at Aspire.Hosting.Dcp.ApplicationExecutor.RunApplicationAsync(CancellationToken cancellationToken) in /_/src/Aspire.Hosting/Dcp/ApplicationExecutor.cs:line 86
   at Aspire.Hosting.Dcp.DcpHostService.StartAsync(CancellationToken cancellationToken) in /_/src/Aspire.Hosting/Dcp/DcpHostService.cs:line 68
   at Microsoft.Extensions.Hosting.Internal.Host.<StartAsync>b__15_1(IHostedService service, CancellationToken token)
   at Microsoft.Extensions.Hosting.Internal.Host.ForeachService[T](IEnumerable`1 services, CancellationToken token, Boolean concurrent, Boolean abortOnFirstException, List`1 exceptions, Func`3 operation)
   at Microsoft.Extensions.Hosting.Internal.Host.StartAsync(CancellationToken cancellationToken)
   at Microsoft.Extensions.Hosting.HostingAbstractionsHostExtensions.RunAsync(IHost host, CancellationToken token)
   at Microsoft.Extensions.Hosting.HostingAbstractionsHostExtensions.RunAsync(IHost host, CancellationToken token)
   at Aspire.Hosting.DistributedApplication.RunAsync(CancellationToken cancellationToken) in /_/src/Aspire.Hosting/DistributedApplication.cs:line 133
   --- End of inner exception stack trace ---
   at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions)
   at System.Threading.Tasks.Task.Wait(Int32 millisecondsTimeout, CancellationToken cancellationToken)
   at System.Threading.Tasks.Task.Wait()
   at Aspire.Hosting.DistributedApplication.Run() in /_/src/Aspire.Hosting/DistributedApplication.cs:line 141
   at Program.<Main>$(String[] args) in D:\_work\Aspire.AppHost\Program.cs:line 32

The 1 minute timeout has been removed, but this is by design as there's a port conflict. We can do a better job throwing an error message here.
@JamesNK do you think we should attempt to detect this misconfiguration and throw a better error?

I actually just wrote a PR that allows for one port: https://github.com/dotnet/aspire/pull/3045
In your situation you would still get an error because you're not using HTTPS. The dashboard would start up, but when the browser opens you would get a message that HTTP/1.1 is negotated on an endpoint that requires HTTP/2.


fix: revert addition of generic font fallbacks

This reverts the specific changes in 83d806c that added generic font fallbacks, and disables the Stylelint rule that required them. We found this caused problems with Bus e-Ink rendering on real hardware.

@jzimbel-mbta Are you able to point your test hardware at dev-green to confirm whether this fixes the font issue?


How to use bfInfo from redisbloom-py

Hello folks. There is a bfInfo function inside Client class from redisbloom. But whenever I try to use that command I got results like <redisbloom.client.BFInfo object at 0x7ff5e00d3290>.
Can you give me example please how can I print the entire information from real BF INFO command here using that function?

Hi @scipe,
BFInfo is an object that has the following properties: capacity, size, filterNum, insertedNum and expansionRate.
You can print them one by one:
info = rb.bfInfo('bloom')
print("capacity = %s" % info.capacity)
print("expansionRate = %s" % info.expansionRate)
print("filterNum = %s" % info.filterNum)
print("insertedNum = %s" % info.insertedNum)
print("size = %s" % info.size)

Or use:
info = rb.bfInfo('bloom')
for attr in dir(info):
    print("info.%s = %r" % (attr, getattr(info, attr)))


Added in verbose error logging

Added in additional error logging for failed cypress tests. This additional logging will only be shown in verbose mode.

Thanks @brady727 !

@tnicola No problem! Could we get a new release cut for this change?

Yes, published!

There was an issue with settings. It should work with the new version 0.8.1


Do Instructions work with flan-T5?

We are trying to make this instruction work with flan-t5 but haven't got it working.  Any ideas would be MOST helpful on how to make it work with this model or any other model.  Of course, this works with GPT3.5 so was curious if this model indeed can support such instructions.
Answer the question as truthfully as possible using the provided context, and if the answer is not contained within the text below, say "I don't know."\n\n
Context:
Install Python with the Official Installer. Download the installer package from Python's official website.
Wait for the download to complete. Once the installation is complete, the installer will automatically open Python's installation directory in a new Finder window.
Installing python on Windows. Open a browser to the Python website and download the Windows installer. 2. Double click on the downloaded file and install Python for all users, and ensure that Python is added to your path. Click on Install now to begin
Installing Python 3 on Linux¶ · $ python3 --version · $ sudo apt-get update $ sudo apt-get install python3. · $ sudo apt-get install software-properties-common $ ...
Question: How do you install Python on Mac?
Answer:

I got it working.  Missing \n\n. formatting issue.  Works well.


settings_org: Split out separate forms for orgs settings/permissions/…

This replaces #5031, and @sarahcstringer will continue with it.

Automated message from Dropbox CLA bot
@showell, it looks like you've already signed the Dropbox CLA. Thanks!


Synthesis failed for SiteVerification

Hello! Autosynth couldn't regenerate SiteVerification. :broken_heart:
Here's the output from running synth.py:
2020-05-09 05:19:47 [INFO] logs will be written to: /tmpfs/src/github/synthtool/logs/googleapis/elixir-google-api
2020-05-09 05:19:47,563 autosynth > logs will be written to: /tmpfs/src/github/synthtool/logs/googleapis/elixir-google-api
Switched to branch 'autosynth-siteverification'
2020-05-09 05:19:49 [INFO] Running synthtool
2020-05-09 05:19:49,330 autosynth > Running synthtool
2020-05-09 05:19:49 [INFO] ['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/site_verification/synth.metadata', 'synth.py', '--']
2020-05-09 05:19:49,331 autosynth > ['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/site_verification/synth.metadata', 'synth.py', '--']
2020-05-09 05:19:49,537 synthtool > Executing /home/kbuilder/.cache/synthtool/elixir-google-api/synth.py.
On branch autosynth-siteverification
nothing to commit, working tree clean
2020-05-09 05:19:49,614 synthtool > Cloning https://github.com/googleapis/elixir-google-api.git.
2020-05-09 05:19:50,057 synthtool > Running: docker run --rm -v/home/kbuilder/.cache/synthtool/elixir-google-api:/workspace -v/var/run/docker.sock:/var/run/docker.sock -e USER_GROUP=1000:1000 -w /workspace gcr.io/cloud-devrel-public-resources/elixir19 scripts/generate_client.sh SiteVerification
2020-05-09 05:19:53,475 synthtool > No files in sources /home/kbuilder/.cache/synthtool/elixir-google-api/clients were copied. Does the source contain files?
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "/tmpfs/src/github/synthtool/synthtool/metadata.py", line 180, in __exit__
    write(self.metadata_file_path)
  File "/tmpfs/src/github/synthtool/synthtool/metadata.py", line 112, in write
    with open(outfile, "w") as fh:
FileNotFoundError: [Errno 2] No such file or directory: 'clients/site_verification/synth.metadata'
2020-05-09 05:19:53 [ERROR] Synthesis failed
2020-05-09 05:19:53,504 autosynth > Synthesis failed
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 599, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 471, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 549, in _inner_main
    ).synthesize(base_synth_log_path)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 118, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/site_verification/synth.metadata', 'synth.py', '--', 'SiteVerification']' returned non-zero exit status 1.

Google internal developers can see the full log here.

Autosynth is still having trouble generating SiteVerification. :sob:
Here's the output from running synth.py:
2020-05-11 05:18:03 [INFO] logs will be written to: /tmpfs/src/github/synthtool/logs/googleapis/elixir-google-api
2020-05-11 05:18:03,455 autosynth > logs will be written to: /tmpfs/src/github/synthtool/logs/googleapis/elixir-google-api
Switched to branch 'autosynth-siteverification'
2020-05-11 05:18:05 [INFO] Running synthtool
2020-05-11 05:18:05,236 autosynth > Running synthtool
2020-05-11 05:18:05 [INFO] ['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/site_verification/synth.metadata', 'synth.py', '--']
2020-05-11 05:18:05,236 autosynth > ['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/site_verification/synth.metadata', 'synth.py', '--']
2020-05-11 05:18:05,419 synthtool > Executing /home/kbuilder/.cache/synthtool/elixir-google-api/synth.py.
On branch autosynth-siteverification
nothing to commit, working tree clean
2020-05-11 05:18:05,752 synthtool > Cloning https://github.com/googleapis/elixir-google-api.git.
2020-05-11 05:18:06,179 synthtool > Running: docker run --rm -v/home/kbuilder/.cache/synthtool/elixir-google-api:/workspace -v/var/run/docker.sock:/var/run/docker.sock -e USER_GROUP=1000:1000 -w /workspace gcr.io/cloud-devrel-public-resources/elixir19 scripts/generate_client.sh SiteVerification
2020-05-11 05:18:10,303 synthtool > No files in sources /home/kbuilder/.cache/synthtool/elixir-google-api/clients were copied. Does the source contain files?
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "/tmpfs/src/github/synthtool/synthtool/metadata.py", line 180, in __exit__
    write(self.metadata_file_path)
  File "/tmpfs/src/github/synthtool/synthtool/metadata.py", line 112, in write
    with open(outfile, "w") as fh:
FileNotFoundError: [Errno 2] No such file or directory: 'clients/site_verification/synth.metadata'
2020-05-11 05:18:10 [ERROR] Synthesis failed
2020-05-11 05:18:10,327 autosynth > Synthesis failed
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 599, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 471, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 549, in _inner_main
    ).synthesize(base_synth_log_path)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 118, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/site_verification/synth.metadata', 'synth.py', '--', 'SiteVerification']' returned non-zero exit status 1.

Google internal developers can see the full log here.

Autosynth is still having trouble generating SiteVerification. :sob:
Here's the output from running synth.py:
2020-05-11 15:21:06 [INFO] logs will be written to: /tmpfs/src/github/synthtool/logs/googleapis/elixir-google-api
2020-05-11 15:21:06,090 autosynth > logs will be written to: /tmpfs/src/github/synthtool/logs/googleapis/elixir-google-api
Switched to branch 'autosynth-siteverification'
2020-05-11 15:21:08 [INFO] Running synthtool
2020-05-11 15:21:08,212 autosynth > Running synthtool
2020-05-11 15:21:08 [INFO] ['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/site_verification/synth.metadata', 'synth.py', '--']
2020-05-11 15:21:08,212 autosynth > ['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/site_verification/synth.metadata', 'synth.py', '--']
2020-05-11 15:21:08,427 synthtool > Executing /home/kbuilder/.cache/synthtool/elixir-google-api/synth.py.
On branch autosynth-siteverification
nothing to commit, working tree clean
2020-05-11 15:21:08,505 synthtool > Cloning https://github.com/googleapis/elixir-google-api.git.
2020-05-11 15:21:08,966 synthtool > Running: docker run --rm -v/home/kbuilder/.cache/synthtool/elixir-google-api:/workspace -v/var/run/docker.sock:/var/run/docker.sock -e USER_GROUP=1000:1000 -w /workspace gcr.io/cloud-devrel-public-resources/elixir19 scripts/generate_client.sh SiteVerification
/workspace /workspace
The mix.lock file was generated with a newer version of Hex. Update your client by running `mix local.hex` to avoid losing data.
Resolving Hex dependencies...
Dependency resolution completed:
Unchanged:
  certifi 2.5.1
  google_api_discovery 0.7.0
  google_gax 0.3.2
  hackney 1.15.2
  idna 6.0.0
  jason 1.2.0
  metrics 1.0.1
  mime 1.3.1
  mimerl 1.2.0
  oauth2 0.9.4
  parse_trans 3.3.0
  poison 3.1.0
  ssl_verify_fun 1.1.5
  temp 0.4.7
  tesla 1.3.3
  unicode_util_compat 0.4.1
A new Hex version is available (0.20.1 < 0.20.5), please update with `mix local.hex`
All dependencies are up to date
The mix.lock file was generated with a newer version of Hex. Update your client by running `mix local.hex` to avoid losing data.

22:21:11.592 [info]  FETCHING: https://www.googleapis.com/discovery/v1/apis/siteVerification/v1/rest

22:21:11.737 [info]  FOUND: https://www.googleapis.com/discovery/v1/apis/siteVerification/v1/rest
Revision check: old=20191119, new=20191119, generating=true
Creating leading directories
Writing SiteVerificationWebResourceGettokenRequest to clients/site_verification/lib/google_api/site_verification/v1/model/site_verification_web_resource_gettoken_request.ex.
Writing SiteVerificationWebResourceGettokenRequestSite to clients/site_verification/lib/google_api/site_verification/v1/model/site_verification_web_resource_gettoken_request_site.ex.
Writing SiteVerificationWebResourceGettokenResponse to clients/site_verification/lib/google_api/site_verification/v1/model/site_verification_web_resource_gettoken_response.ex.
Writing SiteVerificationWebResourceListResponse to clients/site_verification/lib/google_api/site_verification/v1/model/site_verification_web_resource_list_response.ex.
Writing SiteVerificationWebResourceResource to clients/site_verification/lib/google_api/site_verification/v1/model/site_verification_web_resource_resource.ex.
Writing SiteVerificationWebResourceResourceSite to clients/site_verification/lib/google_api/site_verification/v1/model/site_verification_web_resource_resource_site.ex.
Writing WebResource to clients/site_verification/lib/google_api/site_verification/v1/api/web_resource.ex.
Writing connection.ex.
Writing metadata.ex.
Writing mix.exs
Writing README.md
Writing LICENSE
Writing .gitignore
Writing config/config.exs
Writing test/test_helper.exs
fixing file permissions
2020-05-11 15:21:12,634 synthtool > No files in sources /home/kbuilder/.cache/synthtool/elixir-google-api/clients were copied. Does the source contain files?
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "/tmpfs/src/github/synthtool/synthtool/metadata.py", line 180, in __exit__
    write(self.metadata_file_path)
  File "/tmpfs/src/github/synthtool/synthtool/metadata.py", line 112, in write
    with open(outfile, "w") as fh:
FileNotFoundError: [Errno 2] No such file or directory: 'clients/site_verification/synth.metadata'
2020-05-11 15:21:12 [ERROR] Synthesis failed
2020-05-11 15:21:12,669 autosynth > Synthesis failed
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 599, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 471, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 549, in _inner_main
    ).synthesize(base_synth_log_path)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 118, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/site_verification/synth.metadata', 'synth.py', '--', 'SiteVerification']' returned non-zero exit status 1.

Google internal developers can see the full log here.

Autosynth is still having trouble generating SiteVerification. :sob:
Here's the output from running synth.py:
2020-05-12 05:20:43 [INFO] logs will be written to: /tmpfs/src/github/synthtool/logs/googleapis/elixir-google-api
2020-05-12 05:20:43,817 autosynth > logs will be written to: /tmpfs/src/github/synthtool/logs/googleapis/elixir-google-api
Switched to branch 'autosynth-siteverification'
2020-05-12 05:20:45 [INFO] Running synthtool
2020-05-12 05:20:45,574 autosynth > Running synthtool
2020-05-12 05:20:45 [INFO] ['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/site_verification/synth.metadata', 'synth.py', '--']
2020-05-12 05:20:45,575 autosynth > ['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/site_verification/synth.metadata', 'synth.py', '--']
2020-05-12 05:20:45,785 synthtool > Executing /home/kbuilder/.cache/synthtool/elixir-google-api/synth.py.
On branch autosynth-siteverification
nothing to commit, working tree clean
2020-05-12 05:20:45,864 synthtool > Cloning https://github.com/googleapis/elixir-google-api.git.
2020-05-12 05:20:46,367 synthtool > Running: docker run --rm -v/home/kbuilder/.cache/synthtool/elixir-google-api:/workspace -v/var/run/docker.sock:/var/run/docker.sock -e USER_GROUP=1000:1000 -w /workspace gcr.io/cloud-devrel-public-resources/elixir19 scripts/generate_client.sh SiteVerification
/workspace /workspace
The mix.lock file was generated with a newer version of Hex. Update your client by running `mix local.hex` to avoid losing data.
Resolving Hex dependencies...
Dependency resolution completed:
Unchanged:
  certifi 2.5.1
  google_api_discovery 0.7.0
  google_gax 0.3.2
  hackney 1.15.2
  idna 6.0.0
  jason 1.2.0
  metrics 1.0.1
  mime 1.3.1
  mimerl 1.2.0
  oauth2 0.9.4
  parse_trans 3.3.0
  poison 3.1.0
  ssl_verify_fun 1.1.5
  temp 0.4.7
  tesla 1.3.3
  unicode_util_compat 0.4.1
A new Hex version is available (0.20.1 < 0.20.5), please update with `mix local.hex`
All dependencies are up to date
The mix.lock file was generated with a newer version of Hex. Update your client by running `mix local.hex` to avoid losing data.

12:20:48.879 [info]  FETCHING: https://www.googleapis.com/discovery/v1/apis/siteVerification/v1/rest

12:20:49.012 [info]  FOUND: https://www.googleapis.com/discovery/v1/apis/siteVerification/v1/rest
Revision check: old=20191119, new=20191119, generating=true
Creating leading directories
Writing SiteVerificationWebResourceGettokenRequest to clients/site_verification/lib/google_api/site_verification/v1/model/site_verification_web_resource_gettoken_request.ex.
Writing SiteVerificationWebResourceGettokenRequestSite to clients/site_verification/lib/google_api/site_verification/v1/model/site_verification_web_resource_gettoken_request_site.ex.
Writing SiteVerificationWebResourceGettokenResponse to clients/site_verification/lib/google_api/site_verification/v1/model/site_verification_web_resource_gettoken_response.ex.
Writing SiteVerificationWebResourceListResponse to clients/site_verification/lib/google_api/site_verification/v1/model/site_verification_web_resource_list_response.ex.
Writing SiteVerificationWebResourceResource to clients/site_verification/lib/google_api/site_verification/v1/model/site_verification_web_resource_resource.ex.
Writing SiteVerificationWebResourceResourceSite to clients/site_verification/lib/google_api/site_verification/v1/model/site_verification_web_resource_resource_site.ex.
Writing WebResource to clients/site_verification/lib/google_api/site_verification/v1/api/web_resource.ex.
Writing connection.ex.
Writing metadata.ex.
Writing mix.exs
Writing README.md
Writing LICENSE
Writing .gitignore
Writing config/config.exs
Writing test/test_helper.exs
fixing file permissions
2020-05-12 05:20:49,910 synthtool > No files in sources /home/kbuilder/.cache/synthtool/elixir-google-api/clients were copied. Does the source contain files?
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 102, in <module>
    main()
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmpfs/src/github/synthtool/env/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/tmpfs/src/github/synthtool/synthtool/__main__.py", line 94, in main
    spec.loader.exec_module(synth_module)  # type: ignore
  File "/tmpfs/src/github/synthtool/synthtool/metadata.py", line 180, in __exit__
    write(self.metadata_file_path)
  File "/tmpfs/src/github/synthtool/synthtool/metadata.py", line 112, in write
    with open(outfile, "w") as fh:
FileNotFoundError: [Errno 2] No such file or directory: 'clients/site_verification/synth.metadata'
2020-05-12 05:20:49 [ERROR] Synthesis failed
2020-05-12 05:20:49,942 autosynth > Synthesis failed
Traceback (most recent call last):
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 193, in _run_module_as_main
    "__main__", mod_spec)
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 599, in <module>
    main()
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 471, in main
    return _inner_main(temp_dir)
  File "/tmpfs/src/github/synthtool/autosynth/synth.py", line 549, in _inner_main
    ).synthesize(base_synth_log_path)
  File "/tmpfs/src/github/synthtool/autosynth/synthesizer.py", line 118, in synthesize
    synth_proc.check_returncode()  # Raise an exception.
  File "/home/kbuilder/.pyenv/versions/3.6.9/lib/python3.6/subprocess.py", line 389, in check_returncode
    self.stderr)
subprocess.CalledProcessError: Command '['/tmpfs/src/github/synthtool/env/bin/python3', '-m', 'synthtool', '--metadata', 'clients/site_verification/synth.metadata', 'synth.py', '--', 'SiteVerification']' returned non-zero exit status 1.

Google internal developers can see the full log here.

Autosynth passed, closing! :green_heart:


More than just the image is clickable in voting screen

dashed lines are a border around the img tag.

you want only the visible image to be clickable, not the whole element? i think it should be straightforward to flex center position the a > img inside a container element and set the fixed size on that container instead

Yeah either a good way to show to the user "this whole thing is clickable" or have only the img be clickable.


Playing Multiple Sound files

Its pretty simple, I'm looking to reset the current sound that's playing or not playing and start playing a new one. However all my attempts to reset the variable seem to fall flat and I end up with the error:
"The callback play() exists in module RNSound, but only one callback may be registered to a function in a native module."
How would I go about resetting the file?  What am I missing here?

same

I sorted it in the end, it kinda went away? I can check tomorrow when I'm near my computer.

@Slooowpoke can you post some code?

Woops, forgot about this. Honestly not sure why it went away. I don't think I changed that much.
Using this (state.file is my sound file) code and then loading the new one seemed to work.
if(this.state.file != null){
      this.state.file.pause();
      this.state.file.release();
      this.state.file = null;
}

Some of it might be redundant but it seems to work. I chucked all of that in a reset method that I call when the component unmounts as well. After its called I just load the sound file in as usual.

@Slooowpoke I'm facing the same problem right now.  I'll have 100+ sound files, though. Did you pre load all of your sound files or how did you do it?
What would be the best way to create a playlist with various files?

Mine is even more complicated since I have a dynamical list of sound files

@jwilbert Sorry I didn't see this sooner. Don't preload them all, it's too much. Instead load only the one that should be playing. It should reset with that code above, but I am now using an older version of React-Native (0.41). Hope this is a little bit more helpful.
@wandonye I think it should work the same? My lists is also dynamic

Hi! If you're still experiencing this, could you please open a new issue and include your code?


Dramatic system storage usage (13.71GB)

We used localForage v1.5.0 with the localforage.INDEXEDDB driver on iOS 10.3, and experience the dramatic increase in system storage usage. Reports from users, some increased a few hundred MB's and some even up to 13.71GB, while their actual records size is <=2MB!
We are still not sure what causes such increase, or what is in it. Now we have switched to the localforage.WEBSQL driver (still on localForage v1.5.0) alongside with the previously stored INDEXEDDB database. Surprisingly, even when we no longer read, write or initiates the INDEXEDDB database, system storage did not go down.
In #179 @stevemadere mentioned a leakage from queue trashing, is there any way to safely eliminate it without completely reset the app?

I'm referencing some of the issues I find related to this: #179 #254 #352 #642

Closing this in favor of the other comment in issue #179.


suggested edits

@Kacawi reminder that I have reviewed your suggestions.

@Kacawi I guess we're almost done.

@Kacawi By "almost done" I meant that I left one more comment on this PR. Once resolved I'll merge it. Then, we're left with one paragraph to fix/change if I remember correctly.

@drorata If you referred to the last comment on the new paragraph, I have removed this one.

@Kacawi I updated the paragraph we discussed. Please have a look at #2

@Kacawi I believe #2 is the step, right? Anything else?


Add separate plugin for CLion Nova

A new version of CLion is on the horizon
Upon loading it up I found that the current plugin does not work, am wondering if either it can be updated to support Nova or maybe have a separate experimental plugin available for it.

Could you check if PR #29 makes it work?

Is there any update on this yet?

Nope. This repository's owner has been inactive since 26 of September last year.

temp solution is to build the plugin and install manually

Guys never forgot you. Going to do it next days.

Is it all good now guys?


Add new unit tests and some refactoring to make testing easier

Extract TransactionRequestDtoFactory from CardanoTokenSender
Extract EligibleDonationsService from DonationJob
Use @Inject instead of constructor dependencies in various places
Add BlockChainServicesFactory to build all service beans related to BlockFrost API

Hi Matti
Please feel free to ignore this PR, if you like.  Your original code is well designed and high quality!  The refactoring you see in the PR has mainly to do with making unit testing easier.  My PR ended up being far more invasive than I wanted.  And you won't hurt my feelings by discarding the PR.   I didn't do a comprehensive job writing tests either.  I only wrote a couple, so that I could spend time with the code and learn how to the blockfrost/bloxbean API.
On the other hand, you may find some value in the refactoring, which would be great. I'd also be glad to collaborate with you on other Java project needs.  I've been trying to learn smart contracts using Haskell and more recently trying to use the PAB beta codebase.  That has been rather frustrating, and I feel like I'm not accomplishing much.  Perhaps, I should continue to keep a hand in the Java work, as it appears one can accomplish a lot using Blockfrost/Bloxbean APIs.  Are you working on Bloxbean API, btw?
Thanks
Kurt

Kurt... I will have a look, please join Cardano Fans on telegram: https://t.me/cardano_fans
Also reminder, on Fridays, 13.15 - 14.15 UTC we have special ZOOM / Google Meet session for developers.

Hi, thanks for the invite to your Telegram group and the developer meeting.  I added myself to the cardano_fans telegram group.  Unfortunately, I wasn't paying close attention to the timezone of the DEV meeting, so I missed that.  I should be able to make the next one, thought. :)
Thanks

Thanks for the review.  Fixed changes.

Thank You very much!


New-PnPAzureCertificate: The FriendlyName value cannot be set on Unix.

Reporting an Issue or Missing Feature
When I execute New-PnPAzureCertificate on Mac OS Big Sur, I get an error stating that the FriendlyName cannot be set on Unix.
New-PnPAzureCertificate -OutPfx "pnp.pfx" -ValidYears 1 -CertificatePassword $secPassword
I haven't done much with these certificates before, but from everything I have read, i think I am doing it right.
Expected behavior
Output of a pfx file.
Actual behavior
The following error occurs on Mac OS Big Sur:
New-PnPAzureCertificate: The FriendlyName value cannot be set on Unix.
Steps to reproduce behavior
Please include complete code samples in-line or linked from gists
$Password = "mypassword"
$secPassword = ConvertTo-SecureString -String $Password -AsPlainText -Force
New-PnPAzureCertificate -OutPfx "pnp.pfx" -ValidYears 1 -CertificatePassword $secPassword

What is the version of the Cmdlet module you are running?
(you can retrieve this by executing Get-Module -Name sharepointpnppowershell* -ListAvailable)
PnP.PowerShell 0.3.3

Thanks for reporting!
It's fixed and it will be available in nightly build of tomorrow (0.3.5).

Thanks Erwin!  It's always a relief to know it's a real issue and not user error on my part.  I'll give it a try in a couple of days.


NIFI-3478: Added Support for EL in GeoEnrichIP

NIFI-3478: added tests for GeoEnrichIP and added support for expression language on 'IP Address Attribute' property.
For all changes:

[x] Is there a JIRA ticket associated with this PR? Is it referenced
in the commit message?

[x] Does your PR title start with NIFI-XXXX where XXXX is the JIRA number you are trying to resolve? Pay particular attention to the hyphen "-" character.

[x] Has your PR been rebased against the latest commit within the target branch (typically master)?

[x] Is your initial contribution a single, squashed commit?

For code changes:

[x] Have you ensured that the full suite of tests is executed via mvn -Pcontrib-check clean install at the root nifi folder?
[x] Have you written or updated unit tests to verify your changes?
[x] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
[ ] If applicable, have you updated the LICENSE file, including the main LICENSE file under nifi-assembly?
[ ] If applicable, have you updated the NOTICE file, including the main NOTICE file found under nifi-assembly?
[x] If adding new Properties, have you added .displayName in addition to .name (programmatic access) for each of the new properties?

For documentation related changes:

[ ] Have you ensured that format looks appropriate for the output in which it is rendered?

Note:
Please ensure that once the PR is submitted, you check travis-ci for build issues and submit an update to your PR as soon as possible.

nice!  Just checked out the code.  Like it.  Will run some tests.  Thanks

Also can you please address this checkstyle issue
[WARNING] src/test/java/org/apache/nifi/processors/TestGeoEnrichIP.java[41] (imports) AvoidStarImport: Using the '.' form of import should be avoided - org.junit.Assert..
Please feel free to squash the commits.

ok other than items noted have tested and appears ready to roll.  Can now supply an EL statement to find the attribute containing an IP address

I believe I have addressed all concerns and have squashed commits.

sweet.  Will do one last check/build/test and will then merge.  +1.  Thanks!


[SPARK-29152][CORE]Executor Plugin shutdown when dynamic allocation is enabled

What changes were proposed in this pull request?
Added shutdownHook for shutdown method of executor plugin. This will ensure that shutdown method will be called always.

Why are the changes needed?
Whenever executors are not going down gracefully, i.e getting killed due to idle time or getting killed forcefully, shutdown method of executors plugin is not getting called. Shutdown method can be used to release any resources that plugin has acquired during its initialisation. So its important to make sure that every time a executor goes down shutdown method of plugin gets called.

Does this PR introduce any user-facing change?
No.

How was this patch tested?
Tested Manually.

Can one of the admins verify this patch?

Can one of the admins verify this patch?

cc @vanzin

ok to test

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/19877/
Test PASSed.

Test build #115059 has started for PR 26810 at commit 17a7c47.

Test build #115059 has finished for PR 26810 at commit 17a7c47.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/115059/
Test FAILed.

org.apache.spark.rdd.AsyncRDDActionsSuite.async failure handling passes when i run it locally.

retest this please

retest this please

Test build #115112 has started for PR 26810 at commit 17a7c47.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/19925/
Test PASSed.

Test build #115112 has finished for PR 26810 at commit 17a7c47.

This patch fails PySpark unit tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test FAILed.

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/115112/
Test FAILed.

retest this please

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/19935/
Test PASSed.

Test build #115123 has started for PR 26810 at commit 17a7c47.

Test build #115123 has finished for PR 26810 at commit 17a7c47.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/115123/
Test PASSed.

Merging to master. This will not merge cleanly to 2.4, so open a separate PR if you want the backport.


HADOOP-17590 ABFS: Introduce Lease Operations with Append to provide single writer semantics

3026

 Quality gate: Failed
14 Issues

 14 Code issues

Details

 Quality gate: Failed
12 Issues

 12 Code issues

Details


Switched Crashlytics from CocoaPods to Swift Package now Simulator won't build on a M1 Mac

Description
Our app was using CocoaPods but we wanted to switch to Swift Package Manager, so we did that. There are two active devs - one using an Intel Mac the other (me) using a M1 Mac (MacBook Air).
Both of us can compile and run the app on our devices, and the Intel Mac can run the app in the Simulator, But no matter what I do, I cannot get it to build for my M1 (all the common steps, clean build folder, remove Derived Folder and start again, etc).
The error appears to be related to the linker not finding valid binaries (errors attached below).
Reproducing the issue

clean the app, shut Xcode down, delete Derived Folder, restart Xcode
add Firebase Crashlytics as a Swift Package to your app
wait until the package is fetched and resolved
build for a connected device, all is well
build for the Simulator on an M1 Mac, fails to build

Firebase SDK Version
9.6.0
Xcode Version
13.4.2
Installation Method
Swift Package Manager
Firebase Product(s)
Crashlytics
Targeted Platforms
iOS
Relevant Log Output
ld: warning: ignoring file .../Build/Products/Debugging-iphonesimulator/FirebaseCrashlytics.o, building for iOS Simulator-x86_64 but attempting to link with file built for unknown-arm64
... (12 others)
ld: warning: ignoring file .../Build/Products/Debugging-iphonesimulator/FirebaseInstallations.o, building for iOS Simulator-x86_64 but attempting to link with file built for unknown-arm64
Undefined symbols for architecture x86_64:
  "_OBJC_CLASS_$_FIRCrashlytics", referenced from:
      objc-class-ref in <SomeFile>-8e51ce451b9a03f7582a9e76a8faf6a6.o
      objc-class-ref in <SomeFile>-e71967da3e8b662633c9220e635ffc51.o
  "_OBJC_CLASS_$_FIRApp", referenced from:
      objc-class-ref in <SomeFile>-8e51ce451b9a03f7582a9e76a8faf6a6.o
ld: symbol(s) not found for architecture x86_64
clang: error: linker command failed with exit code 1 (use -v to see invocation)

If using Swift Package Manager, the project's Package.resolved

Expand Package.resolved snippet

{
  "pins" : [
    {
      "identity" : "abseil-cpp-swiftpm",
      "kind" : "remoteSourceControl",
      "location" : "https://github.com/firebase/abseil-cpp-SwiftPM.git",
      "state" : {
        "revision" : "583de9bd60f66b40e78d08599cc92036c2e7e4e1",
        "version" : "0.20220203.2"
      }
    },
    {
      "identity" : "boringssl-swiftpm",
      "kind" : "remoteSourceControl",
      "location" : "https://github.com/firebase/boringssl-SwiftPM.git",
      "state" : {
        "revision" : "dd3eda2b05a3f459fc3073695ad1b28659066eab",
        "version" : "0.9.1"
      }
    },
    {
      "identity" : "firebase-ios-sdk",
      "kind" : "remoteSourceControl",
      "location" : "https://github.com/firebase/firebase-ios-sdk.git",
      "state" : {
        "revision" : "7e80c25b51c2ffa238879b07fbfc5baa54bb3050",
        "version" : "9.6.0"
      }
    },
    {
      "identity" : "googleappmeasurement",
      "kind" : "remoteSourceControl",
      "location" : "https://github.com/google/GoogleAppMeasurement.git",
      "state" : {
        "revision" : "c1cfde8067668027b23a42c29d11c246152fe046",
        "version" : "9.6.0"
      }
    },
    {
      "identity" : "googledatatransport",
      "kind" : "remoteSourceControl",
      "location" : "https://github.com/google/GoogleDataTransport.git",
      "state" : {
        "revision" : "5056b15c5acbb90cd214fe4d6138bdf5a740e5a8",
        "version" : "9.2.0"
      }
    },
    {
      "identity" : "googleutilities",
      "kind" : "remoteSourceControl",
      "location" : "https://github.com/google/GoogleUtilities.git",
      "state" : {
        "revision" : "22907832079d808e82f1182b21af58ef3880666f",
        "version" : "7.8.0"
      }
    },
    {
      "identity" : "grpc-ios",
      "kind" : "remoteSourceControl",
      "location" : "https://github.com/grpc/grpc-ios.git",
      "state" : {
        "revision" : "8440b914756e0d26d4f4d054a1c1581daedfc5b6",
        "version" : "1.44.3-grpc"
      }
    },
    {
      "identity" : "gtm-session-fetcher",
      "kind" : "remoteSourceControl",
      "location" : "https://github.com/google/gtm-session-fetcher.git",
      "state" : {
        "revision" : "d4289da23e978f37c344ea6a386e5546e2466294",
        "version" : "2.1.0"
      }
    },
    {
      "identity" : "leveldb",
      "kind" : "remoteSourceControl",
      "location" : "https://github.com/firebase/leveldb.git",
      "state" : {
        "revision" : "0706abcc6b0bd9cedfbb015ba840e4a780b5159b",
        "version" : "1.22.2"
      }
    },
    {
      "identity" : "nanopb",
      "kind" : "remoteSourceControl",
      "location" : "https://github.com/firebase/nanopb.git",
      "state" : {
        "revision" : "819d0a2173aff699fb8c364b6fb906f7cdb1a692",
        "version" : "2.30909.0"
      }
    },
    {
      "identity" : "promises",
      "kind" : "remoteSourceControl",
      "location" : "https://github.com/google/promises.git",
      "state" : {
        "revision" : "3e4e743631e86c8c70dbc6efdc7beaa6e90fd3bb",
        "version" : "2.1.1"
      }
    },
    {
      "identity" : "swift-protobuf",
      "kind" : "remoteSourceControl",
      "location" : "https://github.com/apple/swift-protobuf.git",
      "state" : {
        "revision" : "b8230909dedc640294d7324d37f4c91ad3dcf177",
        "version" : "1.20.1"
      }
    }
  ],
  "version" : 2
}

If using CocoaPods, the project's Podfile.lock

Expand Podfile.lock snippet

Replace this line with the contents of your Podfile.lock!

Thanks for reaching out, @dhoerl. I've tried reproducing the issue on Crashlytics Quickstart using M1 mac, but I didn't encounter the same error. May I know if you opened your Xcode with the Open using Rosetta option enabled? Also, you mentioned that you're using Xcode 13.4.2, but I noticed that there's no 13.4.2 version available. Could you confirm the Xcode version you're using?

Thanks for responding. 13.4.1 - typo. Not using Rosetta. This is a project created originally created 8 years ago, so possibly some old setting or value the cause. I also searched extensively for similar issues but found nothing. I’m a 20 year Xcode veteran but stumped now.
Sent from my iPad

On Sep 20, 2022, at 7:30 AM, rizafran @.***> wrote:

Thanks for reaching out, @dhoerl. I've tried reproducing the issue on Crashlytics Quickstart using M1 mac, but I didn't encounter the same error. May I know if you opened your Xcode with the Open using Rosetta option enabled? Also, you mentioned that you're using Xcode 13.4.2, but I noticed that there's no 13.4.2 version available. Could you confirm the Xcode version you're using?
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you were mentioned.

You're right that it may be related to a lingering setting or artifact in the project. We'll likely need a reproducible example to help.

It seems that if I follow the Apple advice for M1 macs here:
https://developer.apple.com/documentation/technotes/tn3117-resolving-build-errors-for-apple-silicon
The problem is resolved.


Subscriptions return null values

Issue workflow progress

Progress of the issue based on the Contributor Workflow

[x] 1. The issue provides a reproduction available on Github, Stackblitz or CodeSandbox

Make sure to fork this template and run yarn generate in the terminal.
Please make sure Mesh package versions under package.json matches yours.

[x] 2. A failing test has been provided
[ ] 3. A local solution has been provided
[ ] 4. A pull request is pending review

Describe the bug

I need to do subscription from callbacks in an openapi yaml file.
So I tryied this example: openapi-subscriptions which by the way is broken on codesandbox:
error<EMAIL_ADDRESS>The engine "node" is incompatible with this module. Expected version ">=12". Got "10.24.1"
error Found incompatible module.

I managed to make it work, but graphql-mesh is now replacing my values with null.
Then I tried the json-schema-subscriptions examples and had similar problem.
In debug mode, I can see the value being received by graphql-mesh:
🐛 🕸  Mesh - HTTP Received webhook request for /webhooks/todo_added {"id":0,"name":"foo","content":"bar"}
🐛 🕸  Mesh - Example - Subscription.todoAdded Received  {"id":0,"name":"foo","content":"bar"}  from  webhook:post:/webhooks/todo_added

But in GraphiQL or any other client I get:
{
  "data": {
    "todoAdded": {
      "id": null,
      "name": null,
      "content": null
    }
  }
}

To Reproduce
The bug is reproducible with official example of schema subscription

Open the link with google chrome (firefox is kind of broken with codesandbox)
Subscribe:subscription TodoAdded {
    todoAdded {
      id
      name
      content
    }
}

Add a todo:mutation Mutation($input: mutationInput_addTodo_input_Input) {
  addTodo(input: $input) {
    id
  }
}

{
"input": {
   "name": "foo",
   "content": "bar"
 }
}

See the result of the subscription{
 "data": {
   "todoAdded": {
     "id": null,
     "name": null,
     "content": null
   }
 }
}

Enjoy the problem

You can add DEBUG=1 in the mesh:dev script in packages.json to see the data being received by graphql-mesh.

Expected behavior
Subscription should give values not null
{
  "data": {
    "todoAdded": {
      "id": "ad88b3e0-3f86-4401-9354-c6aedaa6d820",
      "name": "foo",
      "content": "bar"
    }
  }
}

Environment:

OS:
@graphql-mesh/...:
NodeJS:

Additional context

@kantum  Did you get any solution for above subscription issue?
because I am also getting the same error. Please let me know if you find any solution.

@RahulSadaphalXebia No, I think it's internal to graphql-mesh, didn't have time to investigate.
I guess by testing older versions of graphql-mesh it might work as documented. Then by incrementing version you may find where it comes from.

Fixed via https://github.com/Urigo/graphql-mesh/commit/2365f8986b69754482d71a5b414b697a9ff86b98


Update LLVM to commit d7f0083d and remove explicit usage of parser and printer

This updates LLVM to commit d7f0083d (just about a day ahead from the existing commit) when parser and printer were made obsolete. Then we leverage the new hasCustomAssemblyFormat property to replace parser and printer.
Signed-off-by: Stella Stamenova<EMAIL_ADDRESS>

Jenkins Linux ppc64le Build #3156 [push] Update LLVM to commit d7... started at 10:24

Jenkins Linux s390x Build #4040 [push] Update LLVM to commit d7... started at 10:22

Jenkins Linux s390x Build #4040 [push] Update LLVM to commit d7... passed after 1 hr 29 min

Jenkins Linux ppc64le Build #3156 [push] Update LLVM to commit d7... passed after 1 hr 45 min

Jenkins Linux amd64 Build #4049 [push] Update LLVM to commit d7... aborted after 1 hr 48 min