Send email notification when user's email address or password is changed

For security reasons when a user changes their email address we should send a notification letting them know (to both their old address and their new address) in case the change was unauthorised.

Pinging @zwolf - this seems like a nice issue to touch a few different parts of the system.

Updating title to include password change (as suggested by @marten )

If you're working on this one related issue was that currently you can be added to a Zooniverse project without knowing unless you go to the lab section frequently. Having an email when you get added to any project role on a project builder project would be extremely helpful.
https://github.com/zooniverse/Panoptes-Front-End/issues/1749

I've got a basic idea of what these emails should say, but if anyone would like to specify the language used, please do.

Currently:
"Your Zooniverse email address has been successfully changed.
(or)
Your Zooniverse password has been successfully changed.
If you believe this to be in error, please contact .
Thanks,
The Zooniverse Team"
How's that? What should that email address be?

looks good ( I assume that's 2 different emails).
Email from address is setup here and in the devise config as well.

also should this be If you believe this to be in error, please contact support (email here?).

Yeah, oops. That's the email I'm looking for, the one for support.

@astopy @mrniaboc do we have support@ or should it be contact@

<EMAIL_ADDRESS>is the one to use I think.

On 23 May 2016, at 20:55, Campbell Allen<EMAIL_ADDRESS>wrote:
@astopy @mrniaboc do we have support@ or should it be contact@
—
You are receiving this because you were mentioned.
Reply to this email directly or view it on GitHub

I'm pretty sure Chris Snyder shut down support@ when he was tidying up Zooniverse gmail.

seems i should have known about this page, https://www.zooniverse.org/about/contact

Closed by #1855


Fix FPU problem and add basic RISC-V64 support

PR checklist

[ ] Updated function header with a short description and version number
[ ] Added test case for bug fix or new feature
[ ] Validated on real hardware

@salcogn, can you teach what RiscV chip is targeted by this patch?

@salcogn, can you teach what RiscV chip is targeted by this patch?

The CV1800B RISC-V64 chip contains two T-Head C906 processors, and ThreadX runs on the small C906 core without MMU.

@alcogn, thanks! that sounds like a milkv duo device.

@alcogn, thanks! that sounds like a milkv duo device. I am wondering if targeting qemu-system-riscv64 can be easier for sharing?

Yes，target device is Milk-duo 64MB. Here is a  detailed repo. And you are right, targeting qemu-system-riscv64 is easier to share, I am also working on relevant adaptation work.


LICENSE-ADDITION file

Hi,
I put the GPLv3 license in LICENSE.rst, while in LICENSE-ADDITION.rst I only put specifics of clauses like "GPLv3 or later" and the "zip exception" (so it isn't a different license but only a detail of the first).
The license isn't detected.
Can you please support this use-case?
Example: https://github.com/micro-a5k/microg-unofficial-installer

This is the output I get:
/# git clone https://github.com/micro-a5k/microg-unofficial-installer
...
/# cd microg-unofficial-installer/
/microg-unofficial-installer# licensee
License: Other
Matched files: ["LICENSE.rst", "LICENSE-ADDITION.rst"]
LICENSE.rst:
  Content hash: 2ee7d237d0f84bfaff912f2aed71da75914a90f1
  Confidence: 99.85%
  Matcher: Licensee::Matchers::Dice
  License: GNU General Public License v3.0
  Closest licenses:
    * GPL-3.0 similarity: 99.85%
    * AGPL-3.0 similarity: 95.58%
LICENSE-ADDITION.rst:
  Content hash: 1fb37d2b196b958e713ea19ff0eaa79fc5265a7c
  License: Other

@ale5000-git when you said that "The license isn't detected", did you mean by licensee or by GitHub?

It detect GPLv3 for LICENSE.rst but the problem is that for the project it say License: Other

Since the LICENSE-ADDITION.rst contain:

    <one line to give the program's name and a brief idea of what it does.>
    Copyright (C) <year>  <name of author>

    This program is free software: you can redistribute it and/or modify
    it under the terms of the GNU General Public License as published by
    the Free Software Foundation, either version 3 of the License, or
    (at your option) any later version.

    This program is distributed in the hope that it will be useful,
    but WITHOUT ANY WARRANTY; without even the implied warranty of
    MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
    GNU General Public License for more details.

    You should have received a copy of the GNU General Public License
    along with this program.  If not, see <https://www.gnu.org/licenses/>.

It should detect that it is the same license and not a different one (and maybe also detect the v3 or later clause).

while in LICENSE-ADDITION.rst I only put specifics of clauses like "GPLv3 or later" and the "zip exception"

Computers aren't smart enough to parse human readable legal text. As such Licensee can't determine the contents of LICENSE-ADDITION and does not currently support specifying licenses in such a away.

What about just a plain text search of "This program is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version"?
This text is present in almost all GPL licensed projects.
It just need to remove duplicate spaces and newlines before searching.

It's conceivable we could detect and do something with known license and exception statements (as opposed to license texts) in license/copyright/notices files but that's a pretty big task, starting with figuring out what the right behavior would be. I don't see working on that on the horizon so closing this rather than let stalebot passively do so. 😄


<EMAIL_ADDRESS>has unmet peer dependency "<EMAIL_ADDRESS>

Describe the bug
When installing Bugsnag with the React plugin following the install instructions a peerDependency warning is show during yarn install.
While it is listed as a peerDependency in package.json the @bugsnag/core package actually says that it's not likely something a user would want to install and the instruction in the React plugin README do not mention it.
Seems like an incorrect PeerDependency, or READMEs need to be updated?
Steps to reproduce

Go to https://github.com/bugsnag/bugsnag-js/tree/next/packages/plugin-react#installation
Add bugsnag to project with yarn add @bugsnag/js @bugsnag/plugin-react per install instructions
PeerDep warning will display warning " ><EMAIL_ADDRESS>has unmet peer dependency "<EMAIL_ADDRESS>
Environment

Bugsnag version: 7.5.3
Browser framework version (if any):

React: 16.13.1

Hi @greggb,
Thanks for the report. We're aware of this and think that the best route forward is to mark the peer dependency as optional for yarn. We don't have a firm timeframe for when this will be scheduled yet, but it's on our backlog.

Thanks for the update Yousif

Hi @himynameisdave, this is still on our backlog, and we do plan on working on it soon. I don't have an exact timeframe to give you but we will post here with updates.

We've just released v7.16.5 of bugsnag-js which marks @bugsnag/core as an optional peer dependency  to avoid the warnings described above 🎉


Package conflict on LogisticRegression tutorial

Question on: https://turing.ml/dev/tutorials/2-logisticregression/
When I try to follow along on this guide in my own notebook, there are some package management issues. When loading the RDataset, there is an identifier not found error, which was resolved by using the RData#master package as recommended here.
I can download the dataset now, but the MLDataUtils package is now incompatible. When I try to add it, I get this error due to some conflict with required versions of DataFrames packages:
 MLDataUtils [cc2ba9b6] log:

 ├─possible versions are: [0.4.0, 0.5.0-0.5.1] or uninstalled

 ├─restricted to versions * by an explicit requirement, leaving only versions [0.4.0, 0.5.0-0.5.1]

 └─restricted by compatibility requirements with DataFrames [a93c6f00] to versions: uninstalled — no versions left

   └─DataFrames [a93c6f00] log:

     ├─possible versions are: [0.11.7, 0.12.0, 0.13.0-0.13.1, 0.14.0-0.14.1, 0.15.0-0.15.2, 0.16.0, 0.17.0-0.17.1, 0.18.0-0.18.4, 0.19.0-0.19.4, 0.20.0-0.20.2, 0.21.0-0.21.1] or uninstalled

     └─restricted to versions 0.21 by RData [df47a6cb], leaving only versions 0.21.0-0.21.1

       └─RData [df47a6cb] log:

         ├─possible versions are: 0.7.2 or uninstalled

         └─RData [df47a6cb] is fixed to version 0.7.2

Thanks for the issue, but the point I was trying to make here is that this has nothing to do with us -- it's not something we can fix. There is no benefit to having an issue here for something that is largely out of our control.
If you want the tutorials to work, you can go back down to RData 0.7 or use the Julia evironment defined by the Manifest and Project files in the TuringTutorials repo. These should function without issue, since it's the environment that rendered the tutorials.

Okay thanks.


BKR-639: Adds compile masters to the array of roles

in the not_controller method, so that agents on compile_master systems will show as controllers

Refer to this link for build results (access rights to CI server needed):
http://jenkins-beaker.delivery.puppetlabs.net//job/qe_beaker_btc-intn/1834/
Test PASSed.

@erikPrime is there any kind of master that would be considered "not a controller"?  What is a master of master's role?  I'm wondering if perhaps we should have a separate check in that method to just make sure nothing that ends in _master is included.  What do you think?

So... while we're in here.   Is there a way we can define def controller?, with a positive statement about what it means to be a controller?  We could then make def not_controller() !controller? end and deprecate it.

last comments still current

last comments still current

It looks like this commit is tied to the wrong JIRA ticket (BKR-629). Please update the commit message & PR title to point to the correct one.

@kevpl Sorry I lost contact on this PR.
Q1.  Is there any kind of master that would be considered "not a controller" ?
A: No.  The beaker role of the master of masters is "master".  You COULD argue that this ought to be handled by the "agent_only" logic, but that isn't where pry led me...
Q2: ...perhaps we should have a separate check in that method to just make sure nothing that ends in _master is included
A:  I don't think that would help, because "controller" means "master", "dashboard", "database", and now "compile_master"
@rick I completely agree.  Even worse, when I grep through the beaker repo the word "controller" is sometimes used as above [ master, dashboard, database, compile_master ] and sometimes used as the host on which beaker is executing, the 'test controller'.
So I'm going to look to see if we can refactor our file_sync tests to use the "agent_only" method instead of the "not_controller" method...


my xamarin app is not getting updated.

SignalR for.Net Core is not compatible with the previous version of SignalR for the Full .Net framework.
SignalR clients written in the full framework cannot be used with hubs in Asp.Net core (and vice-versa).


PDF deployment replica does not honor values

PDF deployment uses a constant replica count of 1
https://github.com/getlago/lago-helm-charts/blob/5af7bbda386e59d8624af86d8f37a454ae0ccc3d/templates/pdf-deployment.yaml#L8
And does not honor the helm values:
https://github.com/getlago/lago-helm-charts/blob/5af7bbda386e59d8624af86d8f37a454ae0ccc3d/values.yaml#L179

PR: https://github.com/getlago/lago-helm-charts/pull/80

Merged, thanks for fixing it!


Yarn Plug and Play Zero-Installs: Cannot Cy with github actions

Same cannot get it to work. A timeout occurs during pipe run:
Opening Cypress...
[1965:1017/182222.115087:ERROR:node_bindings.cc(278)] Most NODE_OPTIONs are not supported in packaged apps. See documentation for more details.
[1965:1017/182222.115179:ERROR:node_bindings.cc(278)] Most NODE_OPTIONs are not supported in packaged apps. See documentation for more details.
[1965:1017/182224.237041:ERROR:bus.cc(392)] Failed to connect to the bus: Could not parse server address: Unknown address type (examples of valid types are "tcp" and on UNIX "unix")
[1965:1017/182224.237078:ERROR:bus.cc(392)] Failed to connect to the bus: Could not parse server address: Unknown address type (examples of valid types are "tcp" and on UNIX "unix")
[2138:1017/182224.258717:ERROR:gpu_init.cc(441)] Passthrough is not supported, GL is swiftshader
[1965:1017/182224.491841:ERROR:bus.cc(392)] Failed to connect to the bus: Could not parse server address: Unknown address type (examples of valid types are "tcp" and on UNIX "unix")
[1965:1017/182224.516792:ERROR:bus.cc(392)] Failed to connect to the bus: Could not parse server address: Unknown address type (examples of valid types are "tcp" and on UNIX "unix")

.yml
name: CI
on: push

jobs:
  build:
    runs-on: ubuntu-latest
    steps:
    - uses: actions/checkout@v2

    - name: Get yarn cache directory path
      id: yarn-cache-dir-path
      run: echo "::set-output name=dir::$(yarn config get cacheFolder)"

    - uses: actions/cache@v2
      id: yarn-cache
      with:
        path: ${{ steps.yarn-cache-dir-path.outputs.dir }}
        key: ${{ runner.os }}-yarn-${{ hashFiles('**/yarn.lock') }}
        restore-keys: |
          ${{ runner.os }}-yarn-

    - name: Yarn Install if no cache hit
      if: steps.yarn-cache.outputs.cache-hit != 'true'
      run: yarn add --cached

    - name: Eslint
      run: yarn lint

    - name: Run Component tests 🧪
      uses: cypress-io/github-action@v2
      with:
        install-command : yarn install --immutable --immutable-cache
        command: yarn cypress run-ct

Since this issue was posted, the github-action has been enhanced to deal with Yarn Modern. This does not however cover Yarn Plug'n'Play for which there is an open enhancement request https://github.com/cypress-io/github-action/issues/969.

See README > Yarn Plug'n'Play for a documented workaround of using the action with Yarn Plug'n'Play.  Note that Cypress itself still has compatibility issues with Yarn Plug'n'Play.

Closing this issue in favor of the enhancement request https://github.com/cypress-io/github-action/issues/969.


Add support to IntentBuilder() for no names

This allows creation of intents with no name.  The names are not used
internally within Adapt, but this is particularly useful within other
ecosystems such as Mycroft Skills which can automatically name the intent
appropriately from context.

Ping!

Closing this in favor of using a subclass for other ecosystems that set it on their own terms.


Parse GCP project ID from gcp.json instead of config.json

Documentation for https://github.com/api3dao/airnode/issues/1317

@dcroote What should we do with this one. If not part of v0.12 should we tag it v0.13?

Right now the corresponding Airnode issue is marked v0.13, but that may change soon

I've moved it to milestone 0.14.0

Closing to clear older Airnode-related issues from the docs. Can reopen if work on the corresponding Airnode issue resumes.


[Proposal] Include LOD information into VoxelData trait

To help with deciding on how detailed the density information should be, the VoxelData trait could be updated:
https://github.com/Gnurfos/transvoxel_rs/blob/9043633b82f40c44230202d233e380443853dde4/src/traits.rs#L39
pub trait VoxelData: Default + Clone + Copy {
    /// The type that acts as density
    type Density: Density;
    /// How to get the density from a given data object
    //From:  fn density(&self ) -> Self::Density;
    fn density(&self, cell_size:  f32) -> Self::Density;
}

The function usage inside the library contains this information in  let rot = self.current_rotation;:
https://github.com/Gnurfos/transvoxel_rs/blob/9043633b82f40c44230202d233e380443853dde4/src/implementation/algorithm.rs#L469
This would make it possible to provide better representative density information through VoxelData by enabling the trait implementers to use the size of the iterating cube.

I understand the need for different density information quality (and cost) for different LOD levels, and didn't think about this before. Your proposition raises some concerns to me, though, after a very quick consideration:

I am afraid having this argument in the VoxelData trait would incur a small cost for people who don't use it (I am not sure how much these methods can get inlined and the argument optimized out)
Wouldn't you prefer to receive something that directly indicates the LOD level itself, rather than the cell_size ?

In my mind, VoxelData was to be kind of inert and just the result of evaluating a field at a given position.
Would it work for your use case, if the field itself was responsible for handling the LOD / density details ?
You would keep in VoxelData only things that transvoxel_rs cares about, and where today you might have something like:
fn f(x, y, z) -> VoxelData;
extract_from_fn(f, ...);

You would wrap f in a (LOD-customizable) field object, and do something like:

let field_for_current_lod = MyField::new(f, Lod::VERY_DETAILED); // Or some less static value like Lod::new(3);
extract_from_field(field_for_current_lod, ...);

Do you think that could work, and makes sense?

I think your proposition makes sense!
In that case the responsibility to align the generated meshes so there are no unintentional holes would fall into the implemented of VoxelData, which brings some additional questions into play though...
Thank you for considering it!

Did you manage to get something ?
It's going to be hard any way, if the f(x,y,z)->density function depends on the LOD, but I really feel like the "voxel source" is the right place to handle this. That said, I'm not sure the current implementation provides you enough information to do it properly: to avoid holes, you need all densities to coincide between neighboring blocks, for a given queried point in space. The issue is that  the algorithm will sometimes call VoxelSource::get_regular_voxel even for a high-res face (assuming it saves memory potentially, but that's maybe not smart). In this case for example:
     LOD N+1          LOD N with transition

   ┌───────┬──────a   A───A────────────D
   │       │      │   │   │            │
   │       │      │   │   │            │
   │       │      │   │   │            │
   │       │      │   │   │            │
   ├───────┼──────b   B   │            │
   │       │      │   │   │            │
   │       │      │   │   │            │
   │       │      │   │   │            │
   │       │      │   │   │            │
   └───────┴──────c   C───C────────────E

You want a==A, b==B, c==C.
But the density for A and C will be queried through get_regular_voxel, so you have no way of knowing that you need to match the higher LOD precision, in this case.
Maybe I should just drop this "optimization", or create a 3rd function (or pass down some flag telling you which resolution is queried). Would any of these help ?
Out of curiosity, are you doing this because you hit a point where generating density is a bottleneck ? What kind of application are  you making ?

I've been thinking about this problem and for sure the information is available to the user through the subdivisions field from block:
https://github.com/Gnurfos/transvoxel_rs/blob/9043633b82f40c44230202d233e380443853dde4/src/voxel_source.rs#L34
If I as a user am calling the extract function I have explicit control over the number of subdivisions there will be inside a field; Which correlates directly with LOD, as for smaller subdivisions lower LOD values match.
I managed to work around most of the limitations by having a reference to the field included inside the mesh builder, so it is possible to query the field itself, and the interpolated positions are available in the call of add_vertex_between.
As for the usage, I generate terrain mesh from voxel information, and currently I am able to generate a panorama for a 256256256 block ( one voxel has 101010 size, so it's a<PHONE_NUMBER>60 landscape), but it's not nearly enough to have the immersion I was looking for so I'm looking to 10x that with optimizations, and pre-rendering ( in progress ), and one of the optimization possibilities is to have the field in different LODs. I was also experimenting with https://crates.io/crates/meshopt, but it messes up the connecting vertex positions so I'm not sure if that's a plausible use here.

I think reading subdivisions is not enough to avoid holes, as it is constant across the block. But it won't tell you what resolution of voxel is being queried by the algorithm. In my example above, voxels A/B/C, despite being used within the block of lod N, have to produce densities equal to the ones produced by a/b/c (in a block of lod N+1).


actions: add zenodo

This will be a github action that can fetch/push data from/to Zenodo using its API. Most of the code that implemented the popper archive feature in branch 1.x can be re-used.
The code for this action will reside here.

Hey, @ivotron I have created an action for upload functionality, please take a look at this repository. Also could you please let me know how can I take input for the content of zenodo-research-output and pass that to entrypoint.sh.

hey @arshul , thanks a lot for taking the time to work on this. That repo is a great starting point. The variable that holds the token can be called ZENODO_API_TOKEN, which will need to be defined as a secret by users.
When uploading to Zenodo, there are two alternatives, either the deposition is new, or
the deposition already exists. In the latter case, the user needs to provide the ID, which can be captured by a ZENODO_DEPOSIT_ID environment variable.  This same variable can be used for the publish and download tasks.
When uploading or downloading files, users might also want to download a particular file, rather than the whole contents of the archive, so we can use a ZENODO_FILES variable to specify this.

Hey @ivotron the upload action is working and I have made the changes you suggested, also I have created publish action to publish a deposition.
The Download feature is not yet supported by Zenodo API .
Though the upload is working, could you please tell me how should I set the metadata for the deposition, I mean currently the metadata is hardcoded in the request, we will need to make that user-defined.
And the steps to upload a file to an existing deposition.
Thanks.

@arshul , thanks a lot for working on this!

The Download feature is not yet supported by Zenodo API .

Download is a typical http-based operation that can be done with curl (e.g. curl -LO <url>). The idea here is to provide the following:

allow users to specify the ID of the record via a ZENODO_RECORD_ID variable. For example:
ZENODO_RECORD_ID=439946

This would then be resolved by prepending https://zenodo.org/record/, so the URL would be https://zenodo.org/record/439946

allow users to specify a DOI via a ZENODO_DOI variable. For example:
ZENODO_DOI=10.5281/zenodo.600730

This would then be resolved using the DOI service, by prepending https://doi.org/ to the ID. In this case, the URL used to resolve the record would be https://doi.org/10.5281/zenodo.600730.

an optional list of files. For example:
ZENODO_FILES="parameters.par,1003_topo30sec_wSplays_sim5_pumgenSM2.dtc1-v2-suma.20.nc"

if no list of files is given, all the files in the archive are downloaded.

allow users to specify where to store the files in the workspace via a ZENODO_OUTPUT_DIR variable. For example:
ZENODO_OUTPUT_DIR=./data/

If the folder does not exist, the action creates it. If the folder exists, then we check the files in the folder against the ones in the archive. If they're the same, then nothing gets downloaded.

This can also be used to specify the other stuff I described above (ZENODO_RECORD_ID, ZENODO_DOI, ZENODO_OUTPUT_DIR, etc.).
For the sake of simplicity, the JSON file only contains metadata which can be as it is passed to curl.

hey @arshul , I noticed you opened a couple of PRs on the popperized/zenodo repo. Are they incorporating different functionality for the zenodo actions? Do you want me to review any of them?

Yes. I have created different PRs for different features. Please review them.

Zenodo's features are all done.
From downloading files to creating a record in a single workflow. Please take a look at the PRs and let me know if anything is needed to be improved.

Looks like PRs https://github.com/popperized/zenodo/pull/2 and https://github.com/popperized/zenodo/pull/3 are sharing commits from https://github.com/popperized/zenodo/pull/1 . So let's focus on getting https://github.com/popperized/zenodo/pull/1 merged first, and then you can rebase from the others


Ferc714

Scrape FERC 714

After setting up a venv for the scrapers, I tried running pip install -r requirements.txt and got this error:
Building wheels for collected packages: factory-boy
  Building wheel for factory-boy (setup.py) ... error
  ERROR: Command errored out with exit status 1:
   command: /home/zane/code/catalyst/scrapers/pudl-scrapers/bin/python3 -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-8jww2kzz/factory-boy/setup.py'"'"'; __file__='"'"'/tmp/pip-install-8jww2kzz/factory-boy/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-3n9ahod6
       cwd: /tmp/pip-install-8jww2kzz/factory-boy/
  Complete output (6 lines):
  usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
     or: setup.py --help [cmd1 cmd2 ...]
     or: setup.py --help-commands
     or: setup.py cmd --help

  error: invalid command 'bdist_wheel'
  ----------------------------------------
  ERROR: Failed building wheel for factory-boy
  Running setup.py clean for factory-boy
Failed to build factory-boy

The subsequent pip install -e ./ seemed to succeed though.  Then I tried running scrapy crawl ferc714 anyway just to see if it would work, and it did.
However, it failed to download the raw FERC 714 data, producing the log output below. It looks like maybe the 180 second timeout is short enough that it was unable to get the 50MB file downloaded before timing out?
2020-08-31 23:05:08 [scrapy.utils.log] INFO: Scrapy 2.3.0 started (bot: pudl)
2020-08-31 23:05:08 [scrapy.utils.log] INFO: Versions: lxml <IP_ADDRESS>, libxml2 2.9.10, cssselect 1.1.0, parsel 1.6.0, w3lib 1.22.0, Twisted 20.3.0, Python 3.8.2 (default, Jul 16 2020, 14:00:26) - [GCC 9.3.0], pyOpenSSL 19.1.0 (OpenSSL 1.1.1g  21 Apr 2020), cryptography 3.1, Platform Linux-5.4.0-42-generic-x86_64-with-glibc2.29
2020-08-31 23:05:08 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.epollreactor.EPollReactor
2020-08-31 23:05:08 [scrapy.crawler] INFO: Overridden settings:
{'AUTOTHROTTLE_DEBUG': True,
 'AUTOTHROTTLE_ENABLED': True,
 'AUTOTHROTTLE_START_DELAY': 1,
 'AUTOTHROTTLE_TARGET_CONCURRENCY': 5.0,
 'BOT_NAME': 'pudl',
 'CONCURRENT_REQUESTS_PER_DOMAIN': 5,
 'EDITOR': 'gvim',
 'NEWSPIDER_MODULE': 'pudl.spiders',
 'SPIDER_MODULES': ['pudl.spiders'],
 'USER_AGENT': 'Mozilla/5.0 (Windows NT 6.1; WOW64; rv:64.0) Gecko/20100101 '
               'Firefox/64.0'}
2020-08-31 23:05:08 [scrapy.extensions.telnet] INFO: Telnet Password: 9c64a01c60e7b2f5
2020-08-31 23:05:08 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.throttle.AutoThrottle']
2020-08-31 23:05:08 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2020-08-31 23:05:08 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy.spidermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware']
2020-08-31 23:05:08 [scrapy.middleware] INFO: Enabled item pipelines:
['pudl.pipelines.PudlPipeline']
2020-08-31 23:05:08 [scrapy.core.engine] INFO: Spider opened
2020-08-31 23:05:08 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2020-08-31 23:05:08 [scrapy.extensions.telnet] INFO: Telnet console listening on <IP_ADDRESS>:6023
2020-08-31 23:05:14 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (54175794) larger than download warn size (33554432) in request <GET https://www.ferc.gov/sites/default/files/2020-06/form714-database-June-2020.zip>.
2020-08-31 23:05:47 [scrapy.core.downloader.handlers.http11] WARNING: Received more bytes than download warn size (33554432) in request <GET https://www.ferc.gov/sites/default/files/2020-06/form714-database-June-2020.zip>.
2020-08-31 23:06:08 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2020-08-31 23:07:08 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2020-08-31 23:08:08 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2020-08-31 23:08:08 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://www.ferc.gov/sites/default/files/2020-06/form714-database-June-2020.zip> (failed 1 times): User timeout caused connection failure: Getting https://www.ferc.gov/sites/default/files/2020-06/form714-database-June-2020.zip took longer than 180.0 seconds..
2020-08-31 23:08:14 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (54175794) larger than download warn size (33554432) in request <GET https://www.ferc.gov/sites/default/files/2020-06/form714-database-June-2020.zip>.
2020-08-31 23:09:08 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2020-08-31 23:10:08 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2020-08-31 23:11:08 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2020-08-31 23:11:08 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying <GET https://www.ferc.gov/sites/default/files/2020-06/form714-database-June-2020.zip> (failed 2 times): User timeout caused connection failure: Getting https://www.ferc.gov/sites/default/files/2020-06/form714-database-June-2020.zip took longer than 180.0 seconds..
2020-08-31 23:11:12 [scrapy.core.downloader.handlers.http11] WARNING: Expected response size (54175794) larger than download warn size (33554432) in request <GET https://www.ferc.gov/sites/default/files/2020-06/form714-database-June-2020.zip>.
2020-08-31 23:12:08 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2020-08-31 23:13:08 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2020-08-31 23:14:08 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2020-08-31 23:14:09 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://www.ferc.gov/sites/default/files/2020-06/form714-database-June-2020.zip> (failed 3 times): User timeout caused connection failure: Getting https://www.ferc.gov/sites/default/files/2020-06/form714-database-June-2020.zip took longer than 180.0 seconds..
2020-08-31 23:14:09 [scrapy.core.scraper] ERROR: Error downloading <GET https://www.ferc.gov/sites/default/files/2020-06/form714-database-June-2020.zip>
Traceback (most recent call last):
  File "/home/zane/code/catalyst/scrapers/pudl-scrapers/lib/python3.8/site-packages/twisted/internet/defer.py", line 1416, in _inlineCallbacks
    result = result.throwExceptionIntoGenerator(g)
  File "/home/zane/code/catalyst/scrapers/pudl-scrapers/lib/python3.8/site-packages/twisted/python/failure.py", line 512, in throwExceptionIntoGenerator
    return g.throw(self.type, self.value, self.tb)
  File "/home/zane/code/catalyst/scrapers/pudl-scrapers/lib/python3.8/site-packages/scrapy/core/downloader/middleware.py", line 44, in process_request
    return (yield download_func(request=request, spider=spider))
  File "/home/zane/code/catalyst/scrapers/pudl-scrapers/lib/python3.8/site-packages/twisted/internet/defer.py", line 654, in _runCallbacks
    current.result = callback(current.result, *args, **kw)
  File "/home/zane/code/catalyst/scrapers/pudl-scrapers/lib/python3.8/site-packages/scrapy/core/downloader/handlers/http11.py", line 374, in _cb_timeout
    raise TimeoutError("Getting %s took longer than %s seconds." % (url, timeout))
twisted.internet.error.TimeoutError: User timeout caused connection failure: Getting https://www.ferc.gov/sites/default/files/2020-06/form714-database-June-2020.zip took longer than 180.0 seconds..
2020-08-31 23:14:09 [scrapy.core.engine] INFO: Closing spider (finished)
2020-08-31 23:14:09 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 3,
 'downloader/exception_type_count/twisted.internet.error.TimeoutError': 3,
 'downloader/request_bytes': 924,
 'downloader/request_count': 3,
 'downloader/request_method_count/GET': 3,
 'elapsed_time_seconds': 540.281359,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2020, 9, 1, 4, 14, 9, 226802),
 'log_count/DEBUG': 2,
 'log_count/ERROR': 2,
 'log_count/INFO': 19,
 'log_count/WARNING': 4,
 'memusage/max': 97726464,
 'memusage/startup': 53452800,
 'retry/count': 2,
 'retry/max_reached': 1,
 'retry/reason_count/twisted.internet.error.TimeoutError': 2,
 'scheduler/dequeued': 3,
 'scheduler/dequeued/memory': 3,
 'scheduler/enqueued': 3,
 'scheduler/enqueued/memory': 3,
 'start_time': datetime.datetime(2020, 9, 1, 4, 5, 8, 945443)}
2020-08-31 23:14:09 [scrapy.core.engine] INFO: Spider closed (finished)

These changes have been integrated into the census scraper PR #11


Add live restore to info

This add the status of the live-restore settings to both docker info output and the docker reload event.

Hum weird error on both experimental and janky… Restarting to see if it's some flaky tests :sweat:
22:43:43 ----------------------------------------------------------------------
22:43:43 FAIL: docker_cli_events_unix_test.go:399: DockerDaemonSuite.TestDaemonEvents
22:43:43
22:43:43 [d66463119] waiting for daemon to start
22:43:43 [d66463119] daemon started
22:43:43 docker_cli_events_unix_test.go:440:
22:43:43     c.Assert(out, checker.Contains, fmt.Sprintf("daemon reload %s (cluster-advertise=, cluster-store=, cluster-store-opts={}, debug=true, default-runtime=runc, labels=[\"bar=foo\"], max-concurrent-downloads=1, max-concurrent-uploads=5, name=%s, runtimes=runc:{docker-runc []})", daemonID, daemonName))
22:43:43 ... obtained string = "2016-07-24T20:43:40.886610213Z daemon reload RN7G:CVDZ:MEWK:TNXX:RLIQ:ATVX:VU7M:BBWM:V7AK:6456:75B7:3UCI (cluster-advertise=, cluster-store=, cluster-store-opts={}, debug=true, default-runtime=runc, labels=[\"bar=foo\"], live-restore=false, max-concurrent-downloads=1, max-concurrent-uploads=5, name=e70623bc2bdb, runtimes=runc:{docker-runc []})\n"
22:43:43 ... substring string = "daemon reload RN7G:CVDZ:MEWK:TNXX:RLIQ:ATVX:VU7M:BBWM:V7AK:6456:75B7:3UCI (cluster-advertise=, cluster-store=, cluster-store-opts={}, debug=true, default-runtime=runc, labels=[\"bar=foo\"], max-concurrent-downloads=1, max-concurrent-uploads=5, name=e70623bc2bdb, runtimes=runc:{docker-runc []})"
22:43:43
22:43:43 [d66463119] exiting daemon
22:43:47
22:43:47 ----------------------------------------------------------------------

Looks to be failing again, @vdemeester :cry:

@thaJeztah Oh actually the error is legit.
@mlaventure you need to update this test with , live-restore=false in it because you added an attribute to the event 👼

Yes, I always forget about this test :sweat_smile:

Should be fixed, I've also taken the opportunity to update TestInfoEnsureSucceeds to check the presence of Live Restore: in docker info output.

LGTM (if green)

The failed test in experimental (TestLinksPingLinkedContainers) is not related to info whatsoever and I  can't reproduce it locally, is this a new flaky test? :(

I think this needs rebased or something?

It needs a PR in engine-api, I'll make it now.

@mlaventure docker/engine-api#335 merged, you can update vendoring 👼

LGTM

failure is unrelated TestSwarmNodeTaskListFilter

LGTM

LiveRestoreEnabled.

@stevvooe Do you mean you want the output to be "Live Restore: enabled/disabled"?

@mlaventure I think he means; rename the property to LiveRestoreEnabled (and possibly Live Restore Enabled: true)

oh, I see. Well, if a couple more people agree with that name change, I'll do it.
ping @crosbymichael @icecrime

I do agree with @thaJeztah 👼

I think he means; rename the property to LiveRestoreEnabled (and possibly Live Restore Enabled: true)

Yes, I meant this. When there is a feature flag, it makes it clear that that is the purpose if suffixed with enabled/disabled. It helps to frame the search for usage of the field if you don't know what it is for.

@mlaventure Needs a rebase sadly

@justincormack thanks, done.

LGTM 🐯


FR: Firebase Performance Monitoring - Support for Swift Package Manager

Feature proposal

Firebase Component: Firebase Performance Monitoring

Firebase Performance Monitoring has not yet been added to Swift Package Manager. It would be nice to have this feature.
@paulb777 https://github.com/firebase/firebase-ios-sdk/issues/6362#issuecomment-694317104 recommended creating a separate issue to track interest in Swift Package Manager support for Firebase Performance Monitoring. Thumbs up this issue to indicate that this is a high priority feature.

Do you have a deadline to add support for Firebase Messaging as well? @paulb777

@noah-trilling Thanks for opening the issue. At this point, we're still working through the planning for FirebasePerformance.  We'll update here when we have more to report. In the meantime, the thumbs help us to prioritize :)
@joaoduartemariucio Firebase Messaging SPM has landed in our next major Firebase breaking change branch in #6541 which should get out in the next few months.

@paulb777  Perfect, thanks for the feedback.

is it possible to sideline pod 'Firebase/Performance', or is the podspec going to cause issues dependency conflicts with spm. I guess i can just give it a try

The pod dependencies are likely to cause problems. A better workaround would be to get its binary from the zip distribution  or Carthage distribution.

@paulb777  duh, sorry.  Thanks for working on this

@paulb777 Could you please notify this issue when the version of Firebase Message with SPM support is released. I am looking forward to implementing it in my project. Or if there is a place that I can follow?

@joaoduartemariucio The FirebaseMessaging SPM support will be coordinated with the release of this milestone - https://github.com/firebase/firebase-ios-sdk/milestone/37

@paulb777 I see that adding SPM support for Performance is slated for Firebase 7. We are migrating to SPM in our project and, unfortunately, will need to drop our dependency on Performance. For planning purposes, is there an estimated timeline for the Firebase 7 release?

@clayellis-cricut Sorry, we don't communicate dates for anything not in this GitHub repo and even there we only share expectations based on our typical release patterns. While, Firebase Messaging is slated for Firebase 7, Firebase Performance is not.  We'll add a milestone to this issue when it's expected.

Thanks for the timely response. Makes sense.

Anything new regarding this issue?

For those that haven't seen, Messaging was added to the 7.0 release already.
Firebase Performance was just open sourced last night and is a major unblocker for SwiftPM support, but one blocker remains. Once FirebasePerformance removes its dependency on Protobuf, we'll be able to add support. No current ETA at the moment but stay tuned. Thanks!

Any progress on this front? This is the last thing holding me back from dropping Cocoapods. Thanks!

Any updates on this?

Any updates on this?

From what I can see in the board I believe the task is yet to be done.
Meanwhile, did anyone managed to setup Firebase Performance (from the zip distribution) side by side with Firebase Analytics (from SPM)?

@lsvra I ended up moving all firebase stuff to Carthage for now (don't want to hassle with cocoapods anymore) :|

Any updates on this?

From what I can see in the board I believe the task is yet to be done.
Meanwhile, did anyone managed to setup Firebase Performance (from the zip distribution) side by side with Firebase Analytics (from SPM)?

I believe you need to create a new manifest for the frameworks in the zip and solving those dependencies. I just needed Performance so I created a local package with Performance.xcframework and it's dependencies.

@timstudt
would you mind describing exactly what you did....a friend of mine is asking ;)

@timstudt
would you mind describing exactly what you did....a friend of mine is asking ;)

sure, I used it for iOS14 only project, in a local swift package called Analytics.
in Firebase top folder:
// swift-tools-version:5.3
// The swift-tools-version declares the minimum version of Swift required to build this package.

import PackageDescription

let package = Package(
    name: "Firebase",
    products: [
        .library(
            name: "FirebaseAnalytics",
            targets: [
            "FirebaseAnalyticsUmbrella",
            ]),
        .library(
            name: "FirebasePerformance",
            targets: [
                "FirebasePerformanceUmbrella",
            ]),
    ],
    dependencies: [
    ],
    targets: [
        .target(
            name: "FirebaseAnalyticsUmbrella",
            dependencies: [
                .target(name: "FirebaseAnalytics", condition: .when(platforms: [.iOS])),
                "FirebaseCore",
                "FirebaseCoreDiagnostics",
                "FirebaseInstallations",
                .target(name: "GoogleAppMeasurement", condition: .when(platforms: [.iOS])),
                "GoogleDataTransport",
                "GoogleUtilities",
                "nanopb",
                "PromisesObjC",
            ],
            path: "./FirebaseAnalytics/Sources"
        ),
        .target(
            name: "FirebasePerformanceUmbrella",
            dependencies: [
              "FirebaseABTesting",
              .target(name: "FirebasePerformance", condition: .when(platforms: [.iOS])),
              "FirebaseRemoteConfig",
              .target(name: "Protobuf", condition: .when(platforms: [.iOS])),
            ],
            path: "./FirebasePerformance/Sources"
        ),
        // FirebaseAnalytics
        .binaryTarget(name: "FirebaseAnalytics", path: "./FirebaseAnalytics/FirebaseAnalytics.xcframework"),
        .binaryTarget(name: "FirebaseCore", path: "./FirebaseAnalytics/FirebaseCore.xcframework"),
        .binaryTarget(name: "FirebaseCoreDiagnostics", path: "./FirebaseAnalytics/FirebaseCoreDiagnostics.xcframework"),
        .binaryTarget(name: "FirebaseInstallations", path: "./FirebaseAnalytics/FirebaseInstallations.xcframework"),
        .binaryTarget(name: "GoogleAppMeasurement", path: "./FirebaseAnalytics/GoogleAppMeasurement.xcframework"),
        .binaryTarget(name: "GoogleDataTransport", path: "./FirebaseAnalytics/GoogleDataTransport.xcframework"),
        .binaryTarget(name: "GoogleUtilities", path: "./FirebaseAnalytics/GoogleUtilities.xcframework"),
        .binaryTarget(name: "nanopb", path: "./FirebaseAnalytics/nanopb.xcframework"),
        .binaryTarget(name: "PromisesObjC", path: "./FirebaseAnalytics/PromisesObjC.xcframework"),
        // FirebasePerformance
        .binaryTarget(name: "FirebaseABTesting", path: "./FirebasePerformance/FirebaseABTesting.xcframework"),
        .binaryTarget(name: "FirebasePerformance", path: "./FirebasePerformance/FirebasePerformance.xcframework"),
        .binaryTarget(name: "FirebaseRemoteConfig", path: "./FirebasePerformance/FirebaseRemoteConfig.xcframework"),
        .binaryTarget(name: "Protobuf", path: "./FirebasePerformance/Protobuf.xcframework"),
    ] // targets
)

in my own package:
// swift-tools-version:5.3

import PackageDescription

let package = Package(
    name: "Analytics",
    platforms: [
        .iOS(.v14),
    ],
    products: [
        .library(
            name: "Analytics",
            type: .static,
            targets: ["Analytics"]
        ),
    ],
    dependencies: [
        .package(name: "Firebase", path: "<path-to-firebase>"),
    ],
    targets: [
        .target(
            name: "Analytics",
            dependencies: [
                .product(name: "FirebasePerformance", package: "Firebase"),
                .product(name: "FirebaseAnalytics", package: "Firebase"),
            ],
            path: "Sources"
        )
    ]
)

it seems to work, but not sure if this is the best way to add it.

@timstudt You are a legend good sir! Thank you so much.

@shanecowherd please share if it works for you or what solution you come up with

Any updates?

An update would be great as this has been preventing a full migration away from Firebase Carthage. Does https://github.com/firebase/firebase-ios-sdk/pull/7680 relate?

Thanks a lot for highlighting the importance of the migration. We have been putting our energy to get this effort started up soon. We are currently targeting some critical changes for the upcoming I/O and after that we would have this prioritized and landed soon. We will use this thread updated as we set an ETA for this effort.

With the latest release of 8.0.0 and SPM being out of beta I was wondering if there is an update or ETA for this?

FirebaseAuth, specifically google sign-in also doesnt support SPM yet (you need to download the google sign in pod). Is there somewhere I can request this

FirebaseAuth does support SPM, but GoogleSignIn does not yet. See #6477

@harrygt See the comment from @visumickey above about the FirebasePerformance plans.

Any new updates on adding Performance to SPM ?

ETA? Thanks

Any news? Thanks!

It's been over a month, any update @visumickey?

We are super glad to say that we have been working on this for the last 2 weeks and we are nearing completion for this effort. This is our highest priority and we are committed to land this change in the next few weeks (hopefully in the order of 1 or 2). We will keep this thread posted on the launch date once the changes are complete.
Honestly, this effort is much trickier than we thought since we have used Protobuf extensively and moving to NanoPb is nothing short of a medium size refactor.

++

Looks like its finally been merged. Any idea when the next release will be coming?

We're targeting to release it next week (the week of August 16th) with Firebase 8.6.0

Closing, since the fix is merged and staged for the next release.

Has anyone been able to get this to work? I'm not seeing anything in the logs for Performance with the 8.6.0 update.

Hi @geeklingo, Firebase 8.6.0 was published today and the new version should be available now for SPM users. The update includes SPM support for Performance. The release notes are in the process of being published so please check back later to see release logs for 8.6.0. Apologies for any confusion! Let us know if you have any additional questions or run into any issues

Hi yes, thanks and can confirm it's working. You just have to remember to add the module, that was my mistake.

@ncooke3 as a heads up, Firebase Performance Monitoring was not included in the Firebase 8.6.0 release notes.

Thanks @bdrelling, Performance's 8.6.0 release notes are live now.

Thanks @ncooke3, and thanks for everyone's hard work on getting this over the finish line!


Add webpack aliases for Gutenberg components

It would be great to import components from WordPress with @wp alias, like @youknowriad does here:  https://github.com/youknowriad/gcf/blob/master/scripts/blocks/components/field/index.js#L2
Relevant lines in his webpack:
https://github.com/youknowriad/gcf/blob/master/webpack.config.js#L41-L46

@ahmadawais I can't figure out what file I would modify to change the webpack config and package.json that is generated. Can you link me to that or show me where to look please? If you could point me in the right direction, I could do a PR.

@Shelob9 this is where you should be looking at https://github.com/ahmadawais/create-guten-block/tree/master/packages/cgb-scripts/config
But I am not entirely sure why it's being done like this while we should have all that as packages. Also, how would it work with Gutenberg plugin that only has built plugin and not dev files?

Maybe I can ask @youknowriad to weigh in on this?

You're right, at some point we may provide some of these modules as npm packages but If you import them as packages, each plugin will have its own version as opposed to using the aliased global variable.  So I think using the globals is the way to go for most of these packages (not sure about components yet)

@youknowriad If I am not wrong then we cannot use something like this while creating GutenBlocks?
import { withInstanceId } from "@wordpress/components";

@ahmadawais If you configure Webpack to make @wordpress/components point to the wp.components global like I did in GCF, you could do it.

@ahmadawais
The externals configuration option provides a way of excluding dependencies from the output bundles.
Prevent bundling of certain imported packages and instead retrieve these external dependencies at runtime.
More info on Webpack externals

Can we have a "src" directory alias like VueCLI has "@"?


Couldn't read: 007000.txt of ground truth.

When I am running train.py，I get some errors.
ERROR: Couldn't read: 007000.txt of ground truth. Please write me an email!
An error occured while processing your results.
Please make sure that the data in your zip archive has the right format!
Why?
Thanks!

This error message is printed by the Kitti Evaluation code. Most likely this means, that you did not download
"data_object_label_2.zip". Did you run download_data.py?

I run download_date.py,errors:
2017-02-19 21:38:33,851 ERROR Wrong url.
2017-02-19 21:38:33,851 ERROR Please visit: http://www.cvlibs.net/download.php?file=data_road.zip
2017-02-19 21:38:33,851 ERROR and request Kitti Download link.
2017-02-19 21:38:33,851 ERROR Rerun scipt using'python download_data.py --kitti_url [url]'
sorry ,I am a novice,so I have many problems.Thanks

download from  this website:http://www.cvlibs.net/download.php?file=data_road.zip???

You need to do Step 4 of the readme. That is:

Follow this link: http://www.cvlibs.net/download.php?file=data_object_image_2.zip
Enter your email address in the field. You will receive an email containing the actual download URL.
You will get an email with the actual download URL.
run python download_data.py --kitti_url $URL_YOU_RETRIEVED

where you replace $URL_YOU_RETRIEVED with the URL you got emailed.

Thanks


Add cumprod of BatchedTensor(Seq)

Codecov Report
Patch coverage: 100.00% and no project coverage change.

Comparison is base (8093560) 100.00% compared to head (2e18ee2) 100.00%.

Additional details and impacted files
@@            Coverage Diff            @@
##              main      #415   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files           19        19
  Lines         1688      1700   +12
  Branches       176       176
=========================================
+ Hits          1688      1700   +12

Files Changed
Coverage Δ

src/redcat/tensor.py
100.00% <100.00%> (ø)

src/redcat/tensorseq.py
100.00% <100.00%> (ø)

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Opensearch repository-s3 plugin cannot read ServiceAccount token

Description
Allow to specify the identity web token file relatively to the config folder location (configured by OPENSEARCH_PATH_CONFIG so it would be possible to use soft links to access it):
ln -s $AWS_WEB_IDENTITY_TOKEN_FILE "${OPENSEARCH_PATH_CONFIG}/aws-web-identity-token-file"

And refer to it in opensearch.yml:
s3.client.default.identity_token_file: aws-web-identity-token-file

Issues Resolved
Closes https://github.com/opensearch-project/OpenSearch/issues/6312
Check List

[x] New functionality includes testing.

[ ] All tests pass

[ ] New functionality has been documented.

[ ] New functionality has javadoc added

[X] Commits are signed per the DCO using --signoff
[x] Commit changes are listed out in CHANGELOG.md file (See: Changelog)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Codecov Report

Merging #6390 (13eaf3d) into main (1904158) will decrease coverage by 0.08%.
 Consider uploading reports for the commit ac56ce8 to get more accurate results

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more
@@             Coverage Diff              @@
##               main    #6390      +/-   ##
============================================
- Coverage     70.82%   70.75%   -0.08%
+ Complexity    59078    58980      -98
============================================
  Files          4799     4799
  Lines        282434   282440       +6
  Branches      40717    40719       +2
============================================
- Hits         200041   199847     -194
- Misses        65977    66146     +169
- Partials      16416    16447      +31

Impacted Files
Coverage Δ

...opensearch/repositories/s3/S3RepositoryPlugin.java
26.92% <0.00%> (-1.08%)
:arrow_down:

...g/opensearch/repositories/s3/S3ClientSettings.java
77.10% <100.00%> (+0.43%)
:arrow_up:

...java/org/opensearch/repositories/s3/S3Service.java
81.59% <100.00%> (+0.11%)
:arrow_up:

...g/opensearch/index/analysis/CharFilterFactory.java
0.00% <0.00%> (-100.00%)
:arrow_down:

...rch/search/query/QueryPhaseExecutionException.java
0.00% <0.00%> (-66.67%)
:arrow_down:

...rch/test/junit/listeners/ReproduceInfoPrinter.java
9.52% <0.00%> (-66.67%)
:arrow_down:

...g/opensearch/index/translog/TranslogException.java
42.85% <0.00%> (-57.15%)
:arrow_down:

...ava/org/opensearch/action/NoSuchNodeException.java
0.00% <0.00%> (-50.00%)
:arrow_down:

...a/org/opensearch/tasks/TaskCancelledException.java
50.00% <0.00%> (-50.00%)
:arrow_down:

.../opensearch/client/indices/CloseIndexResponse.java
42.50% <0.00%> (-48.75%)
:arrow_down:

... and 493 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.


Update chitchat to 1.5

After making all changes to the cask:

[x] brew cask audit --download {{cask_file}} is error-free.
[x] brew cask style --fix {{cask_file}} left no offenses.
[x] The commit message includes the cask’s name and version.

Thank you for the contribution. It was merged directly as 7cec8436a14e4d4e27dae151e19537aba38eb9a2. Your contribution is still credited to you.


css only accordion added

css only accordion added

Thanks for the contribution!

Hey @xMrAfonso, add hacktoberfest-accepted tag to every PR that merged in the month of October.


How to use SharpDeskBand

I've been having some trouble getting the desk band to work (Windows 10 64-bit), and was wondering if I'm doing anything wrong. I tried compiling the sample desk band and it registers fine via the server manager.
Initially, it didn't show up in the list of desk bands, so I had a look in the registry. I manually added the 'Implemented Categories' key, which made it appear in the list of available toolbars, but when I click on it, nothing happens. Any clues? Thanks!

I, too, could use a quick tutorial on using the SharpDeskBand class. It's non-obvious how to, for instance, create a DeskBand that sits in the taskbar.

https://github.com/dwmkerr/sharpshell/pull/163

It's working fine now in the latest master, all that is needed now is a tutorial. I've raised a separate issue for this: #202


Load testing seems to start - but does not test the specified routes

Hi, according to your instructions when implementing this in my GitHub Actions workflow I get some strange output. It doesn't show which URL is being targeted and I think it's targeting the base URL since I have setup the base URL to produce a 404 error because I don't use a rendering engine. But the API paths should be targeted and produce 200 and be tested, but that doesn't seem to work. I use Express as the framework.
This is the output I get until it timeouts:
> node server.js

npm WARN exec The following package was not found and will be installed: wait-on
Server started on http://localhost:3000
Press Ctrl-C to terminate...
HEAD / 404 6.135 ms - 19
HEAD / 404 1.606 ms - 19
HEAD / 404 1.269 ms - 19
HEAD / 404 1.325 ms - 19
HEAD / 404 1.148 ms - 19.
HEAD / 404 1.458 ms - 19
HEAD / 404 1.066 ms - 19

My loadTest.js file:
import http from 'k6/http'
import { check, group, sleep } from 'k6'

export const options = {
  stages: [
    { duration: '5m', target: 100 }, // simulate ramp-up of traffic from 1 to 100 users over 5 minutes.
    { duration: '10m', target: 100 }, // stay at 100 users for 10 minutes
    { duration: '5m', target: 0 }, // ramp-down to 0 users
  ],
  thresholds: {
    'http_req_duration': ['p(99)<1500'], // 99% of requests must complete below 1.5s
  },
}

const BASE_URL = 'http://localhost:3000';

export default () => {
  const allPosts = http.get(`${BASE_URL}/api/v1/posts`).json()
  check(allPosts, { 'retrieved posts': (obj) => obj.length > 0 })

  const allCategories = http.get(`${BASE_URL}/api/v1/categories`).json()
  check(allCategories, { 'retrieved categories': (obj) => obj.length > 0 })

  sleep(1)
}

This is my GitHub workflow:
name: Load Testing

on: push
#  schedule:
#    - cron: '*/15 * * * *'

jobs:
  test:
    name: k6 Load Test
    runs-on: ubuntu-latest
    services:
      postgres:
        image: postgres:latest
        env:
          POSTGRES_DB: prod
          POSTGRES_USER: postgres
          POSTGRES_PASSWORD: test1234
        ports:
          - 5432:5432
        options: >-
          --health-cmd pg_isready
          --health-interval 10s
          --health-timeout 5s
          --health-retries 5

    env:
      NODE_ENV: production
      DATABASE_URL: postgres://postgres:test1234@<IP_ADDRESS>:5432/prod

    steps:
      - name: Checkout
        uses: actions/checkout@v1

      - name: Install k6
        run: |
          curl https://github.com/loadimpact/k6/releases/download/v0.26.2/k6-v0.26.2-linux64.tar.gz -L | tar xvz --strip-components 1

      - name: Install Packages
        run: |
          npm install

      - name: Start Server and Run Tests
        run: |
          npm start & npx wait-on http://localhost:3000
          ./k6 run tests/k6/loadTest.js

Perhaps I might have misunderstanding the usage of this test JS file that I built, but I used examples of https://k6.io/docs/using-k6/thresholds/ to test different ones with same result.

Hi @mjovanc, from wait-on documentation it seems to  be waiting to get 200 (status ok) on HEAD before it stops.
So basically you block on npm start & npx wait-on http://localhost:3000 and never even execute k6.
I would also recommend to not use a version of k6 that is now over 2 years old ;)
I will be closing this issue, as given the above it's completely unrelated to the k6 action.
If you think otherwise please comment, or if you have an additional problem - please open a new issue.

@mstoykov I have maybe a somewhat related question about the wait-on recipe that you may be able to help with.
I have something running along the lines of:
npm start-server & wait-on --httpTimeout 60000 http-get://localhost:8080 && k6 run src/load-testing/test.js
The server starts, wait-on eventually kicks in and starts k6, and my tests finish. However, nothing is telling the server to stop at this point and the action runs indefinitely. Is there some clever way I can stop the server once my k6 tests are finished? I'd really rather not pull out the kitchen sink here with a process manager of sorts or write a script to spawn a child process.


point out interplay between list comprehension and singleton list

Students sometimes write
[ f x | x <- [y] ]

when they really mean
[ f x | x <- y ]

It's as if they think that by putting the y in brackets they are "declaring" that it is a list. (As if that were not already given by the type of y. Interestingly, I see the same behavior in Prolog code, which doesn't really have a type system. Some students put Prolog variables in [...] when they are lists. Leading to code with [Y] when Ys would be the "sample solution" - signifying the list type at least via variable name convention.)
Putting that aside aside, a few comments on this pull request:

Ideally I would want to automatically tell students that they probably didn't mean [ f x | x <- [y] ] in the first place. But that's not really a job hlint is made for. But by pointing students to the fact that what they wrote is equivalent to [f y], they maybe realize that they actually meant [ f x | x <- y ] originally.

I put the new rule into the teaching group, but arguably it could also belong here in the default group: https://github.com/ndmitchell/hlint/blob/c9bfda7de8c2872d0d207212b123345756084e98/data/hlint.yaml#L586-L590

There is overlap of the rule from this pull request with this one (also in the teaching group): https://github.com/ndmitchell/hlint/blob/c9bfda7de8c2872d0d207212b123345756084e98/data/hlint.yaml#L1136 But I would still propose to keep both. For one thing, hint selection via rule names can be used (and is used at our end) to disable hints about higher-order functions when these are still unknown. So, in fact, in the first exercise sessions students already know about list comprehensions, but not about map, so we will not show them the Use map hint. But the new hint from this pull request could already be shown to them. Moreover, if the new rule would be added to default instead of teaching, the point about rule overlap would be moot, since the other hint is still in teaching only.

I was a bit concerned whether I need an isVar side condition, because this rule has one: https://github.com/ndmitchell/hlint/blob/c9bfda7de8c2872d0d207212b123345756084e98/data/hlint.yaml#L590 But actually, some local experiments seem to indicate that isVar is not needed. (?) Actually, that one line is the only occurrence of isVar in the whole of hlint.yaml. Is it an obsolete left-over?

The isVar is needed, since consider [Just x | Just x <- y] (which just selects out the Just values). Without the isVar that would match, and the conversion would be wrong.
I actually do x <- [y] in list comprehensions relatively often, but usually chained with other real list comp bits, since it gives me the pattern matching. But I think the isVar seems a sufficient condition.
I think: [f x | x <- [y]] ==> [f y] when isVar x seems like a reasonable hint for the default group, as I can't imagine why people would want to do that otherwise?

I updated the PR to move the hint to the default group and to add the isVar side condition.
However, I am now concerned about this argument:

The isVar is needed, since consider [Just x | Just x <- y] (which just selects out the Just values). Without the isVar that would match, and the conversion would be wrong.

Aren't several other default rules then currently wrong for the same reason? For example, this: https://github.com/ndmitchell/hlint/blob/63e0e2c675e885c54546d66a8c84f633b6ef2f25/data/hlint.yaml#L664 doesn't have an isVar side condition, so would match [False | Just False <- a] which isn't semantically equivalent to Data.Maybe.catMaybes a.
Also dangerous then would be: https://github.com/ndmitchell/hlint/blob/63e0e2c675e885c54546d66a8c84f633b6ef2f25/data/hlint.yaml#L694-L695 and: https://github.com/ndmitchell/hlint/blob/63e0e2c675e885c54546d66a8c84f633b6ef2f25/data/hlint.yaml#L1166-L1167
(I guess I'm to blame for some but not all of them, for proposing/adding them in the past.)

i've seen this error: i think it means you have to regenerate 'hints.md'.

i've seen this error: i think it means you have to regenerate 'hints.md'.

Given that's a hassle for people just changing the YAML file, I tend to merge and then send a subsequent patch direct to fix that. It's annoying to have generated code in the repo, but alas, doing anything else is a lot more work.


Allow Custom Field to be hidden when empty (hide_when_empty attribute)

As ...
Ozzie - Operator
I want ...
To hide custom fields when they are empty
So that ...
The detail view is not cluttered with empty custom fields
I know this is done when...

I can set an attribute on a custom field to hide_when_empty (or something similar).
View an object that has a null/empty value for that custom field and not see the custom field.

Optional - Feature groups this request pertains to.

[ ] Automation
[ ] Circuits
[ ] DCIM
[ ] IPAM
[ ] Misc (including Data Sources)
[ ] Organization
[ ] Plugins (and other Extensibility)
[ ] Security (Secrets, etc)
[ ] Image Management
[X] UI/UX
[ ] Documentation
[ ] Other (not directly a platform feature)

Database Changes
Add hide_when_empty attribute to the custom field object.
External Dependencies
No response

This is a partial compromise to https://github.com/nautobot/nautobot/issues/889.

This would be very useful to have in a variety of situations. For our particular use case, we are using many custom fields to store information such as each individual GPU in a compute node. Or firmware version for an InfiniBand card etc. Not having empty fields show would help a lot.
I was about to log a request for this very feature. I'm glad to see it's already been requested.


Improved the Slack integration documentation

Closes #663
✅ Checklist

[x] I have followed every step in the contributing guide
[x] The PR title follows the convention.
[x] I ran and tested the code works

Testing

hosting it locally and making sure code works the way it is supposed to even after the change

Changelog

added Slack group with overview and auth , Tasks  as subgroup
added slack-tasks file
formatted slack overview and auth page

Screenshots

💯

@D-K-P have a review.Thank you

Yeah sure @D-K-P just le me know the typos I'll fix it

Hey @shelar1423  - I will review this properly later today, but please make sure you're following the GitHub example. For example the OAuth section should explain how to use OAuth and also link to Slacks documentation so the user can check the scopes - github example here: https://trigger.dev/docs/integrations/apis/github
Also, for the overview, I've just improved GitHubs so it is a bit clearer. Basically we want to write about how you can use Slack with Trigger.dev - https://trigger.dev/docs/integrations/apis/github. Hope that helps!

@D-K-P sure , meanwhile let me know if the other PR on Airtable is fine .

UPDATED
@D-K-P

Thank you. Almost there:

For the scopes link - here is an updated URL to change (the one you added was legacy): https://api.slack.com/scopes
For the task, please change the channel id to "
Could you add a full example 'Example usage' at the bottom of tasks page (see the github docs for an example), you can use one from the jobs showcase

@D-K-P sure will make the changes right now


Vega-deck.gl demos fail to render charts

This seems to impact all of the demos on sanddance.js.org:

simple vega spec
transition between vega specs
cubeTest

The console includes two errors:
dist.min.js:11 deck: error during initialization of TextLayer({id: 'LAYER_TEXT'}) TypeError: undefined is not iterable (cannot read property Symbol(Symbol.iterator))
    at Object.assign.getFontWidth (dist.min.js:1)
    at e.value (dist.min.js:1)
    ...
    at e.value (dist.min.js:11)
    ...
dist.min.js:1 Uncaught TypeError: undefined is not iterable (cannot read property Symbol(Symbol.iterator))
    at Object.assign.getFontWidth (dist.min.js:1)
    at e.value (dist.min.js:1)
    ...

The page loads, but no graph is displayed:

Platform
Windows 10, Chrome 84.0.4147.135

Looks fixed now, thank for the report.


[Event Request] Table 5940 Service Item "ServiceItemCustomerNo"

Can we please get the following event?
trigger OnValidate()
            var
                ConfirmManagement: Codeunit "Confirm Management";
                IsHandled: Boolean;
            begin
                if "Customer No." <> xRec."Customer No." then begin
                    if CheckifActiveServContLineExist then
                        Error(Text004, FieldCaption("Customer No."), "Customer No.", TableCaption, "No.");

     //Event Request Begin
                IsHandled := false;
                ServiceItemCustomerNo(CurrFieldNo, IsHandled);//EFDW
                if not IsHandled then begin
    //Event Request End

                    ServItemLinesExistErr(FieldCaption("Customer No."));
                    if ServLedgEntryExist then
                        if not ConfirmManagement.GetResponseOrDefault(
                             StrSubstNo(Text017, TableCaption, FieldCaption("Customer No.")), true)
                        then begin
                            "Customer No." := xRec."Customer No.";
                            exit;
                        end;

      //Event Request Begin
                end;
    //Event Request End

                    "Ship-to Code" := '';
                    if ("Customer No." <> '') and
                       (xRec."Customer No." = '')
                    then
                        Status := Status::Installed;
                    ServLogMgt.ServItemCustChange(Rec, xRec);
                    ServLogMgt.ServItemShipToCodeChange(Rec, xRec);
                end;
            end;

[IntegrationEvent(false, false)]
 local procedure ServiceItemCustomerNo(var CurrFieldNo: Integer; var IsHandled: Boolean)
 begin
 end;

Thanks for reporting this. We agree, and we’ll publish a fix asap, either in an update for the current version or in the next major release. Please do not reply to this, as we do not monitor closed issues. If you have follow-up questions or requests, please create a new issue where you reference this one.


⚠ gorzdrav.org has degraded performance

In d5c9f32, gorzdrav.org (https://gorzdrav.org) experienced degraded performance:

HTTP code: 200
Response time: 1627 ms

Resolved: gorzdrav.org performance has improved in 2a81102.


FluentTextField does not set id to its input element

When i inspected an FluentTextField in browset console, its inner input element always have id=control
This causes an issue to appear in chrome inspector. It also prevents autofill from working properly.

The FluentTextField is based on the fluent-text-field web component. A web component includes "internal/private" HTML elements. This Chrome message seems to be an error from Chrome Dev Console, but the code is correct.


Fixed exception during finalize when statement AND db is already closed

Fixes #336

Checking the presence of pinter at the beginning seems no harm. LGTM.


ServiceOrder#checkout* - save checkout date in placed_at

The ServiceOrder model has had a placed_at attribute from the start, but it's never actually used.. this changes #checkout and #checkout_immediately to always fill in placed_at
+ a corresponding spec change
@tinaafitz could you take a look please? We do need the "date ordered" info for order history in SSUI..

@himdel @gmcculloug
Looks good.
I'm sure the date ordered info would be necessary for the order history.

@himdel What happens if the placed_at value is nil?  Many databases will already have ServiceOrder records created that do not have this value populated.  Do we also need a migration to set them to something like the created_at time?

@gmcculloug Aah, good point, thanks.. I'll add a migration..
But I'll use updated_at instead of created_at, because if it was ordered via SSUI, created_at pretty much means the moment an empty cart is created, which is either the moment that user first logged in, or the moment the last cart was ordered.

Migration added... I hope using SQL is OK here, couldn't figure out how to make ServiceOrder.where(:state => "ordered", :placed_at => nil).update_all(...) use that updated_at from each entry..

@himdel Now that we have a data migration we also need a migration spec.  Let me know if you need any help with that.

@gmcculloug thanks, I'd definitely appreciate any feedback :) .. either way, added the spec..

@gmcculloug also, this should be darga/yes, do we need to rename the migration to fit?

@himdel Just realizing the code change is meant for Darga but the migration cannot be backported.  You'll need to split this into 2 PRs.

@gmcculloug how come the migration can't be backported? Doesn't this defeat the purpose of having that migration? Or is it simply that is has to be renamed for darga?

@gmcculloug I removed the migration from this PR, so this one should be darga/yes..
And the migration is now in https://github.com/ManageIQ/manageiq/pull/9539

@himdel @gmcculloug is there a BZ for this?

@dclarizio do we have a Shopping Cart or Order History RFE BZ anywhere? (Couldn't find one except for https://bugzilla.redhat.com/show_bug.cgi?id=1252115 which may be too generic :).)


Update add.py

Added input statement for user convenience.

Made my contribution to the sum.py file


Bump parquet and use arrow-js-ffi

arrow-js-ffi is a much more memory-efficient option for moving Arrow data from Rust to JS because it doesn't require a full buffer copy on the Wasm side to construct an Arrow IPC buffer.
This is pretty much blocked on https://github.com/apache/arrow-rs/issues/5356 or some workaround to it. Because of the way deck.gl handles GPU-based picking, it can have a maximum of 256 layers because their indices are packed into a single channel. We take great care on the Python side to choose a record batch size that limits the number of pickable layers to a max of 256. But because arrow-rs does its own rechunking, we're left with tons of tiny record batches of 1024 rows each, which blows up deck.gl (this is from the parquet-wasm bump, not related to using arrow-js-ffi).
Also blocked on fixing parquet package exports (ref https://github.com/kylebarron/parquet-wasm/pull/414)

Note that we only need a param for the record batch size. In Lonboard we already send separate Parquet files that each contain a single logical Arrow batch. So we really just want to set the  record batch size to a very large number.

I published parquet-wasm 0.6.0 and it would be good to test this again. We should bump parquet-wasm regardless of whether we enable arrow-js-ffi.

Superseded by https://github.com/developmentseed/lonboard/pull/477


fix: use projectDir when getting API version

What does this PR do?
Pass this.projectDirectory to SfProject.resolve when resolving the manifest API version from sfdx-project for a deploy.
This was the last place where SDR tries to resolve the sfdx project from process.cwd, which fails for consumers running code outside of a project (vscode/devops center).
What issues does this PR fix or reference?
@W-12488179@
@W-15734097@
Functionality Before
if you didn't specify sourceapiversion when building a component set, on a deploy it would do an upward dir search for sfdx-project.json starting from process.cwd just to read the API version from it.
For code not running from the project it would throw "couldn't find the project" err even if you passed the projectDir to the component set.
Functionality After
the project will be resolved from projectDir if available.
sf CLI was already doing this so we shouldn't see any behavior change:
https://github.com/salesforcecli/plugin-deploy-retrieve/blob/3417931c3fbbe31d76a7875bbed372529c9a1cbd/src/utils/deploy.ts#L94
https://github.com/salesforcecli/plugin-deploy-retrieve/blob/3417931c3fbbe31d76a7875bbed372529c9a1cbd/src/utils/project.ts#L16

I updated the snapshots rather than setting the sourceApiVersion when building the component set for the tests so that snap tests also fail if this change.


regl-scatter2d 3.2.9 is not avliable

npm install<EMAIL_ADDRESS>npm ERR! code ETARGET
npm ERR! notarget No matching version found for<EMAIL_ADDRESS>
and
npm install<EMAIL_ADDRESS>
up to date in 19s

npm update


[Event Hubs] EventHubConsumerClient > subscribe() with EventPosition specified as > 'after a particular enqueued time' should receive messages correctly failing in nightly runs

Event Hubs nightly test runs are failing with:

Error message:
Hook timed out in 60000ms. If this is a long-running hook, pass a timeout value as the last argument or configure it globally with "hookTimeout".
Stack trace:
Error: Hook timed out in 60000ms.
If this is a long-running hook, pass a timeout value as the last argument or configure it globally with "hookTimeout".

For more details check here:
https://dev.azure.com/azure-sdk/internal/_build/results?buildId=4056540&view=results

It passed on re-run


A list of source files missing Apache license headers

Following Apache license header guideline, all human-readable Apache-developed files that are included within a distribution must include the header text with few exceptions. You can find few exceptions here: which files do not require a license header.
I used Apache Rat to check this repository after excluding a few files, and I got this report. We need to add Apache licensing header to below files.
Unapproved licenses:

  openwhisk-cli/tools/travis/test_openwhisk.sh
  openwhisk-cli/tests/dat/apigw/testswaggerdocinvalid
  openwhisk-cli/tests/dat/apigw/testswaggerdoc2
  openwhisk-cli/tests/dat/apigw/local.api.bad.yaml
  openwhisk-cli/tests/dat/apigw/local.api.yaml
  openwhisk-cli/tests/dat/apigw/testswaggerdoc1V2
  openwhisk-cli/tests/dat/apigw/testswaggerdoc1
  openwhisk-cli/tests/dat/apigw/testswaggerdoc2V2
  openwhisk-cli/tests/dat/actions/argCheck.js
  openwhisk-cli/tests/dat/actions/empty.js
  openwhisk-cli/tests/dat/actions/sort.js
  openwhisk-cli/tests/dat/actions/cat.js
  openwhisk-cli/tests/dat/actions/malformed.py
  openwhisk-cli/tests/dat/actions/echo-web-http.js
  openwhisk-cli/tests/dat/actions/initforever.js
  openwhisk-cli/tests/dat/actions/corsHeaderMod.js
  openwhisk-cli/tests/dat/actions/issue-1562.js
  openwhisk-cli/tests/dat/actions/timeout.js
  openwhisk-cli/tests/dat/actions/niam.py
  openwhisk-cli/tests/dat/actions/multipleHeaders.js
  openwhisk-cli/tests/dat/actions/helloAsync.js
  openwhisk-cli/tests/dat/actions/wc.js
  openwhisk-cli/tests/dat/actions/hello.swift
  openwhisk-cli/tests/dat/actions/malformed.js
  openwhisk-cli/tests/dat/actions/initexit.js
  openwhisk-cli/tests/dat/actions/hello.js
  openwhisk-cli/tests/dat/actions/helloContext.js
  openwhisk-cli/tests/dat/actions/helloDeadline.js
  openwhisk-cli/tests/dat/actions/log.js
  openwhisk-cli/tests/dat/actions/niam.js
  openwhisk-cli/tests/dat/actions/niam.swift
  openwhisk-cli/tests/dat/actions/wcbin.js
  openwhisk-cli/tests/dat/actions/helloOpenwhiskPackage.js
  openwhisk-cli/tests/dat/actions/textBody.js
  openwhisk-cli/tests/dat/actions/pngWeb.js
  openwhisk-cli/tests/dat/actions/base64Web.js
  openwhisk-cli/tests/dat/actions/countdown.js
  openwhisk-cli/tests/dat/actions/ping.js
  openwhisk-cli/tests/dat/actions/emptyJSONResult.js
  openwhisk-cli/tests/dat/actions/echo.js
  openwhisk-cli/tests/dat/actions/split.js
  openwhisk-cli/tests/dat/actions/asyncError.js
  openwhisk-cli/tests/dat/actions/helloPromise.js
  openwhisk-cli/tests/dat/actions/stdenv.py
  openwhisk-cli/tests/dat/actions/applicationError.js
  openwhisk-cli/tests/dat/actions/head.js
  openwhisk-cli/tests/dat/actions/printParams.js
  openwhisk-cli/tests/dat/actions/runexit.js
  openwhisk-cli/tests/src/dat/empty.js
  openwhisk-cli/tests/src/dat/malformed.js
  openwhisk-cli/tests/src/dat/hello.js
  openwhisk-cli/CONTRIBUTING.md
  openwhisk-cli/gradle.properties
  openwhisk-cli/notes.md
  openwhisk-cli/NOTICE.md

The excluded files are:
**/*.json
**/**.gradle
**/gradlew
**/gradle/**
**/.**
**/templates/**
**/*.j2.*
**/.github/**
**/auth.whisk.system
**/auth.guest
**/i18n_resources.go

@daisy-ycguo today we exclude the test directories.  Likely we can document this exception at a minimum, but should try to add the "mini" approved ASF headers.

It can be closed by PR #283 and #235

@daisy-ycguo The files under these "tests" may need headers as they are not performance related.

@mrutkows These dat files under tests are removed. They are not there. So we can close this issue.

@daisy-ycguo, @mrutkows, can this issue be closed?

@dubee @daisy-ycguo I believe we noted this week that all the test files listed above were moved out of this repo. since the authoring of this issue.  IMO, we can close this issue and we should verify that these files now have licenses under where they appear to live now under incubator-openwhisk/tests directory.   Cursory examination of a few of these files indicates they now have headers.
Regardless, this one can be closed IMO.

@daisy-ycguo @dubee for clarity,

tests/dat/actions/*
tests/dat/apigw/*

have all been moved to the main openwhisk repo. under the corresponding "tests" directory there:

https://github.com/apache/incubator-openwhisk/tree/master/tests/dat

and the remaining tests files under this repo. now all have ASF "mini" headers, that is:

openwhisk-cli/tests/src/dat/empty.js
openwhisk-cli/tests/src/dat/malformed.js
openwhisk-cli/tests/src/dat/hello.js


How to generate HumanML3D data from video?

Hello!
Thank you for sharing the dataset. May I ask how to generate data in the same format as HumanML3D from my own recorded video?
As far as I know, we can use the VIBE method to extract smpl data from the video, but the smpl data generated by VIBE is still different from the smplh data provided by AMASS. Can you give me some advice?

Hi, that should not be a problem. Because the Humanact12 dataset, a part of HumanML3D, is from SMPL data. SMPLH and SMPL have the same kinematic chains except SMPLH extraly has hand pose. However, hand pose is not included in our data. So you just need to get the 3d positions of your custom data, and run the motion_representation.py.

Hi, that should not be a problem. Because the Humanact12 dataset, a part of HumanML3D, is from SMPL data. SMPLH and SMPL have the same kinematic chains except SMPLH extraly has hand pose. However, hand pose is not included in our data. So you just need to get the 3d positions of your custom data, and run the motion_representation.py.

thanks for your help!

Hi, that should not be a problem. Because the Humanact12 dataset, a part of HumanML3D, is from SMPL data. SMPLH and SMPL have the same kinematic chains except SMPLH extraly has hand pose. However, hand pose is not included in our data. So you just need to get the 3d positions of your custom data, and run the motion_representation.py.

thanks for your help!

Hi @zhuangzhuang000 , hv you figured out hot to convert VIBE output to HumanML3D format? I am using CLIFF and met the same issue. Thank you!

yeah I also want to know how to convert a single VIBE pose to HumanML3D output.

Hi, that should not be a problem. Because the Humanact12 dataset, a part of HumanML3D, is from SMPL data. SMPLH and SMPL have the same kinematic chains except SMPLH extraly has hand pose. However, hand pose is not included in our data. So you just need to get the 3d positions of your custom data, and run the motion_representation.py.

thanks for your help!

i also want  to know how to convert VIBE output to HumanML3D format. Could u help me ?


Fixed variable value in ONLOAD,JS code

all should be good now
regards,
jorge

Thanks @zjorz, this looks great!


FUSE Options?

I can't find an option to add arguments to FUSE. For example allow_other, allow_root, nonempty and others. Is it possible and, if not, is it planned?

It is possible to add arguments. I've originally forwarded the arguments to FUSE, but because the mountpoint, server ID and token need to be specified, I left it out.
I have two ideas in mind:

Create an "args" argument and pass the FUSE arguments as a string (I think this solution is gross)
Extract the mountpoint, server ID and token, forward the rest over to FUSE

If you have any ideas how to pass in FUSE options, please let me know.

Now -o options should be forwarded to FUSE. Please let me know if it does not work.


Searching "std::[...]" gives "Unable to open this type of link" message

While researching C++ related topics, I searched for "std::fabs" (with and without the quotation marks), but no search results were loaded; only a toast with the message "Unable to open this type of link." I assume that this has something to do with the "site:[...]" search feature, but if so, shouldn't it know the difference between "site:[...]" and "std::[...]"? I thought that surrounding the search term with quotation marks would allow the term to be searched normally, but apparently not. Is this a bug or am I missing something here?

Thanks for reporting this. Yeah, this is a bug, likely the same one captured in #347. Once a fix for 347 is made, that should fix this one, too. Will close this issue for now and you can watch that issue for progress.
Thanks


Reorganize development docs

Signed-off-by: Chen Dai<EMAIL_ADDRESS>Description
This PR is the first one aimed to improve our dev documentation. Currently there are only a few docs in docs/dev/ folder. Actually there are many valuable info in our old docs or PR description. As initial effort, this PR added an index page reorganize existing docs to categories. Meanwhile I extracted a few PR description for main feature to new docs. Will upload more docs in separate PR.
Please see https://github.com/dai-chen/sql-1/blob/refactor-dev-docs-rebased/docs/dev/index.md.
Issues Resolved
https://github.com/opensearch-project/sql/issues/1219
Check List

[ ] New functionality includes testing.

[ ] All tests pass, including unit test, integration test and doctest

[ ] New functionality has been documented.

[ ] New functionality has javadoc added
[ ] New functionality has user manual doc added

[x] Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Codecov Report

Merging #1200 (1fb0d6d) into main (d03c176) will decrease coverage by 35.55%.
The diff coverage is n/a.

@@              Coverage Diff              @@
##               main    #1200       +/-   ##
=============================================
- Coverage     98.31%   62.76%   -35.56%
=============================================
  Files           342       10      -332
  Lines          8730      658     -8072
  Branches        554      119      -435
=============================================
- Hits           8583      413     -8170
- Misses          142      192       +50
- Partials          5       53       +48

Flag
Coverage Δ

query-workbench
62.76% <ø> (?)

sql-engine
?

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

...pensearch/sql/planner/physical/ValuesOperator.java

.../opensearch/sql/planner/logical/LogicalValues.java

...pensearch/sql/planner/physical/RenameOperator.java

...rg/opensearch/sql/data/model/ExprIntegerValue.java

...rotocol/response/format/JsonResponseFormatter.java

...sql/opensearch/request/OpenSearchQueryRequest.java

...alysis/DataSourceSchemaIdentifierNameResolver.java

...rch/sql/opensearch/storage/script/ScriptUtils.java

...request/system/OpenSearchDescribeIndexRequest.java

...n/java/org/opensearch/sql/utils/DateTimeUtils.java

... and 342 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

This is an excellent direction +1

@YANG-DB I've merged this PR right before your comments. Feel free to comment on https://github.com/opensearch-project/sql/issues/1219 if any idea. I will do it in the future PRs. Thanks!

This is not back port to other branch intentionally. Because I think we may need single dedicated branch for Github pages in future.


add Filter by file extension

combobox added with all extensions of index
List of files with findings is filtered if certain Extension ist selected

closing #69

Codecov Report

:exclamation: No coverage uploaded for pull request base (master@cdfe139). Click here to learn what that means.
The diff coverage is n/a.

@@            Coverage Diff            @@
##             master      #74   +/-   ##
=========================================
  Coverage          ?   46.18%
=========================================
  Files             ?       48
  Lines             ?     1899
  Branches          ?      160
=========================================
  Hits              ?      877
  Misses            ?      991
  Partials          ?       31

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update cdfe139...485b67e. Read the comment docs.


Change the param to keyword since parameter following an asterisk parameter is a keyword-only-parameter

Description
Change the param to keyword since parameter following an asterisk parameter is a keyword-only-parameter.
According to https://peps.python.org/pep-0570/#syntax-and-semantics, parameter following an asterisk parameter is a keyword-only-parameter. Docstring writers should declare the parameter as "keyword" according to https://www.sphinx-doc.org/en/master/usage/restructuredtext/domains.html#info-field-lists. If it's declared as a "param" like source code, and sphinx can't read the default value information from written-docstring, it will be considered as a required parameter.
Please add an informative description that covers that changes made by the pull request and link all relevant issues.
If an SDK is being regenerated based on a new swagger spec, a link to the pull request containing these swagger spec changes has been included above.
All SDK Contribution checklist:

[x] The pull request does not introduce [breaking changes]
[ ] CHANGELOG is updated for new features, bug fixes or other significant changes.
[ ] I have read the contribution guidelines.

General Guidelines and Best Practices

[x] Title of the pull request is clear and informative.
[ ] There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, see this page.

Testing Guidelines

[ ] Pull request includes test coverage for the included changes.

API change check
APIView has identified API level changes in this PR and created following API reviews.
azure-ai-ml

Here is an API doc from the review portal for Online Deployment with all the links resolved and required parameter is not listed for all parameters of the constructor:

@harneetvirk, so now "keyword" is the recommended way instead of param? Is that documented somewhere?
@nancy-mejia, @TajiHarrisMicrosoft, @banibrata as FYI.

parameter following an asterisk parameter is a keyword-only-parameter.

@hugoaponte : parameters following an asterisk parameter are a keyword-only-parameter and they should be added as keyword, not param in the docstring.


Improve test maintainability

The current tests are difficult to edit when output needs to change. One approach is to place test input and output data in separate files for easier editing and syntax highlighting. The generated code can also be tested to see if it actually compiles.

Trying to collect some pros and cons for current process (inline quote!d reference) vs. some sort of snapshot testing.
I'll try to keep this up-to-date.
Pro:

no dependencies needed.
whats been done so far. No work needed.

Mixed:

due to the manual process differences in the generated code have to be explicitly acknowledged by changing the quoted code, vs. implicitly acknowledging it by going this is fine in the diff.

this can be good, since it encourages more thinking about the results of this change.
however because many aspects are repeated so often (e.g. the BindGroupX impl) this can be an arduous process that suppresses internal improvements or adjustments, because its too much work. This will grow in relevance as more tests are added.

Contra:

this bloats the size of the source-code - e.g. bindgroup.rs is currently ~ 2/3rds tests, with probably >60% of that code being quoted bindings.

diffs on github make it hard to differentiate between changes to the actual code and generated one

quoted sourcecode doesn't mean it will compile, and does not get linted

currently I have to add a bunch of lint exceptions to the generated code, if the code was in the tree and compiled and linted, some of these changes might better surface and be addressed.

dependencies for 'snapshot-testing' might not be required, but at the very least should be able to be done as dev- or build-dependencies.

We should check the output of assert_eq on changes. Easiest way would probably be to simply test how a change surfaces in wgsl_bindgen .
FYI, these are the lints I currently disable in my application. A lot if this is probably caused by stricter than normal lint rules.
#[allow(
    unused,
    elided_lifetimes_in_paths,
    clippy::approx_constant,
    clippy::module_name_repetitions,
    clippy::pattern_type_mismatch,
    clippy::unreadable_literal,
)]

this bloats the size of the source-code

This is pretty normal if there are a lot of unit tests. The public API is pretty minimal, so these tests wouldn't work as integration tests in the tests folder. I am looking into consolidating some of the unit tests to avoid some repetition.

this can be an arduous process that suppresses internal improvements or adjustments, because its too much work

Most required changes to the tests have been fairly minor from my experience. Please open an issue if something requires more work to change than feels reasonable.

diffs on github make it hard to differentiate between changes to the actual code and generated one

I've started separating out the large WGSL inputs and Rust outputs into separate files. This should make the process easier and give a nicer experience with formatting and syntax highlighting.

dependencies for 'snapshot-testing' might not be required

You can write out the current output to a file in tests temporarily using std::fs::write and the defined pretty printing functions. If all the tests cases pass, I don't see a reason to need to also include the actual output as a separate file from the expected output. I'll reassess if it's worth using snapshot testing after I finish reworking the test suite.


Add leading slash to CreateProcessorTokenAsync URL

The URL that is spawned otherwise will cause the HTTP client to attempt to resolve "sandbox.plaid.comprocessor:443"
Needed for https://github.com/LN-Zap/zap-middleware/issues/5462

The other paths all start with / is there a problem with those?

@v0l I think you take from this that I've removed the forward slash? This PR adds said forward slash to this call. I've tested the changed call with https://github.com/LN-Zap/zap-middleware/pull/6661.

@v0l I think you take from this that I've removed the forward slash? This PR adds said forward slash to this call. I've tested the changed call with LN-Zap/zap-middleware#6661.

Ah yea im color bind :)

Yeah GH's UX team needs to learn how to apply contrast to things :-)


[form mixin] this.listfor and this.tableFor ont working

Errors while using this.listFor and this.tableFor
Uncaught TypeError: data.map is not a function
Uncaught TypeError: Cannot read property '_currentElement' of null

Please provide some context

As seen together it is related to the new version of focus https://github.com/KleeGroup/focus/releases/tag/v0.10.1
All the actions which load data should add  the config param shouldDumpStoreOnActionCall  as an example
actionBuilder({
    service: yourService,
    status: 'loaded',
     shouldDumpStoreOnActionCall : true
})

@JoanaDalmeida can you add an action example, @remigrange  can you check in your project @durandx

 {       load: actionBuilder({
            service: equipmentServices.getEquipmentById,
            node: 'equipment',
            status: 'loaded',
            shouldDumpStoreOnActionCall: true
        })
}


feat(UI): App Details refactor for consistency

Motivation
Follow on refactoring changes from https://github.com/aerogear/mobile-security-service/pull/91 for consistency
What
update variable & file names
Why
code consistency
How
Update variable & file names in code
Verification Steps
Checklist:

[x] Code has been tested locally by PR requester
[ ] Changes have been successfully verified by another team member

Progress

[x] Finished task

Coverage remained the same at 93.69% when pulling 16e9b417cdae4ef238f076ad745ef688c3d1ed19 on damienomurchu:AG-8468-follow-on-changes into 7278c4d171f8ebd1770bc86d95b5776a4b714cb4 on aerogear:master.

@laurafitzgerald almost ready, just need to correct a failing test

@laurafitzgerald done now if you can approve


RenameBug

java 1.8.0_265
git commit dcca0133fb944b495b3cd9adaf76f365e3dbd267
git Date:   Thu Sep 17 21:03:17 2020 +0300
When renaming a method / variable, the type of the variable is lost:
ArrayList  aa23;
ArrayList logins;
the same thing happens with methods.

@KVAC thanks! Looks like generics are lost on the class reloading.

Fixed.


Document the use of .node-dev.json file

I figured out few options and its config name by going through the codebase:
.node-dev.json
{
  "clear": false,
  "notify": false,
  "respawn": true,
  "transpile-only": true,
  "ignore": ["node_modules", "./src/generated"]
}

A tabular format with command, cli usage, config usage, alias would be helpful.
If you can point me a file from where I should take the cli commands names and config file command names then I can add a PR for the same.

file which contains the list of commands I'm not sure if this is the right file where all commands are defined both for cli and config file.