Better DateTime parsing, options to promote NULL int columns to float

When dealing with data types where no 1:1 mapping to np.type is possible, the code needs to have more possibilites to modify column properties.
In particular, this PR addresses

DateTime columns (exported as ISO 8601 string, column index put into parse_csv's parse_dates argument)
Dealing with "Integer" & "Long Integer" columns which may be NULL: promotion rules to np.float_ (either all int columns or the ones not marked "NOT NULL")
There were no tests at all. This commit introduces a few basic tests for column parsing.

I have reviewed these changes, and approve of them being integrated to the upstream repo


Dependencies aren't being published

I'm not sure when this broke, but I just noticed that rebar3 hex publish isn't collecting any of the dependencies that are listed in rebar.config and rebar.lock. They are Hex-published dependencies, and it's able to give me an error when I have a non-Hex dependency present.
I haven't had a chance to debug further, yet.

Try upgrading your rebar3 hex plugin and rebar3 itself. This is likely the bug that came up when the rebar3 lock file format changed.

$ rebar3 plugins upgrade rebar3_hex
===> Fetching rebar3_hex ({pkg,<<"rebar3_hex">>,<<"3.0.0">>})
===> Downloaded package, caching at /Users/waisbrot/.cache/rebar3/hex/default/packages/rebar3_hex-3.0.0.tar
===> Compiling rebar3_hex
$
$ rebar3 version
rebar 3.3.1 on Erlang/OTP 19 Erts 8.1

If I try to publish https://github.com/WhoopInc/dogstatsde (for example):
$ rebar3 hex publish
===> Verifying dependencies...
Publishing dogstatsde 0.7.1+build.48.ref2b9d338
  Description: Send StatsD metrics to Datadog
  Dependencies:

  Included files:
    /Users/waisbrot/git/dogstatsde/LICENSE
    /Users/waisbrot/git/dogstatsde/README.md
    /Users/waisbrot/git/dogstatsde/mix.exs
    /Users/waisbrot/git/dogstatsde/rebar.config
    /Users/waisbrot/git/dogstatsde/rebar.config.script
    /Users/waisbrot/git/dogstatsde/rebar.lock
    /Users/waisbrot/git/dogstatsde/src/dogstatsd.app.src
    /Users/waisbrot/git/dogstatsde/src/dogstatsd.erl
    /Users/waisbrot/git/dogstatsde/src/dogstatsd_app.erl
    /Users/waisbrot/git/dogstatsde/src/dogstatsd_sup.erl
    /Users/waisbrot/git/dogstatsde/src/dogstatsd_vm_stats.erl
    /Users/waisbrot/git/dogstatsde/src/dogstatsd_worker.erl
  Maintainers:
    Nathaniel Waisbrot<EMAIL_ADDRESS>  Licenses: LAGPL
  Links:
    GitHub: https://github.com/WhoopInc/dogstatsde
  Build tools: rebar3, mix
Before publishing, please read Hex CoC: https://hex.pm/docs/codeofconduct
Proceed? ("Y")> n

But the rebar.config lists as deps
{deps, [
        {worker_pool,   "2.1.0"}
       ,{stillir, "1.0.0"}
       ]}.

I've got a rebar.config.script. Maybe that's a problem? Rebar is fetching the dependencies from Hex for compilation.

And to be sure, you don't have the rebar3 hex plugin installed globally? rebar3 plugins list will tell you if you have it twice and it could be using an old version in global.

OK, I see that rebar3 plugins upgrade rebar3_hex should have been telling me "No upgrade needed". I had a ~/.cache/rebar3/hex/default/packages/rebar3_hex-3.0.0.tar, but I think Rebar must not have been able to see it or use it.
I deleted my ~/.cache/rebar3 directory and things now work, but that also destroyed all the evidence.
Seeing your update: I tried to configure the Hex plugin to be installed only globally. It's only mentioned in my global rebar.config.
I'm going to close this because I don't think I can give any useful debugging info with the directory wiped.

thanks. Sounds like there is a bug that lets global plugins slip into the default profile. To upgrade global plugins you have to do rebar3 as global plugins upgrade rebar3_hex, it should have said 'no such plugin' when doing it without as global.


Desktop App

I have contemplating about the endgame of this project. I love the idea and the execution, so far seems surprisingly polished and I hope it will bring more people to jupyter. But there are two things that I find most annoying and daunting when using and explaining it.

How to install it
How to start it

Personally I also hate the waste of vertical space.
What I propose is embracing the great work that has been put into frameworks for javascript desktop apps recently and create something for this. What I imagine is following.

Implement a wrapper around jupyterlab that is able to offload some of the functionality onto OS (menu, floating windows) in electron of similar.
Add desktop specific features to that app (starting and stopping server, opening notebook files form file browser) and possibility to connect to remote server.
Possibly package the app so no other installation is necessary

I do not want a codebase split, only a different way to access the same server using a UI with some extra features added. I am happy to work on this project myself, if there is an interest.

@bliker would an "app" that simply launches chrome in "app" mode do the job?
To see the result:

launch jupyter lab: jupyter lab --no-browser
launch chrome in app mode: google-chrome --app=http://localhost:8888

It would work, but :)

There would still be a useless menu on top on Mac.
No filesystem access (file association)
No extra features like frameless windows - this has no controls but you know what I mean

I will try to make a demo next

Hi @bliker, the pieces of JupyterLab are intended to be used as standalone components where possible, see for example examples/console.  They can be combined using a phosphor application as we do here, or by manually putting the instances together.  We target the browser because there are a whole class of users that require a browser environment, but an electron app based on these components is certainly feasible.  We welcome any feedback where the architecture or an individual component could be made more amenable to other use cases.

I am happy to work on this project myself, if there is an interest.

I think there probably would be interest (the Jupyter mailing list would be a great place to ask!). As @blink1073 said, we hope people can easily use the components in apps other than the browser-based JupyterLab app, so we're happy to work with you on things you need to make this work.
FYI, several people are also working on an electron-based app called nteract, though I don't think it reuses much or any of the JupyterLab work.
I'm going to close this issue in favor of opening specific issues about things we can do to help you in your efforts. Thanks for looking into this! I'm excited to see where it goes!


create a vanilla store with undo/redo capabilities

right now create only returns the hook version

npm i zundo@beta


Refresh PAT for build-docs' GitHub Action step

Describe the bug
The PAT used in build-docs pipeline's GitHub Action step expired, causing the pipeline to fail for merges to main from #4458 onwards
To Reproduce
Steps to reproduce the behavior:

Sample failure can be viewed here https://dev.azure.com/fluidframework/internal/_build/results?buildId=10552&view=logs&s=926788dc-3843-5763-e5bc-e1a2e68d811c

Expected behavior
PAT should be refreshed and build pipeline should pass

This should be resolved. I'll leave this open for the time being while I verify the pipeline works as expected.

Fix works as expected; closing issue.


Set description meta tag correctly

Set the description meta tag correctly when there is no repo
description. Also use the  ability to trim trailing whitespaces,
to make the template cleaner.
This cleans up the current code, and fixes moltam's comment in #2670.

Should be golang 1.4 compatible now.

Thanks!


Fix parameter checks

This PR fixes a few issues reported by tests implemented in #7. Most issues were related to accessing array keys that didn't exist. Find details in the commit logs.
Lines 46-71 are reported as changed, but the only thing that changed is the level of indentation (due to Lines 45 + 71).

Thanks for this, and the other two PRs as well! Nice to see my quick angry hack getting more widely-used and some love from the greater community. :)

You are welcome :grin:
Unfortunately I managed to break the script with this line: https://github.com/fluffy-critter/php-urljoin/blob/5b9a32cd1bdc6f81106328b090055ea675a986a8/src/urljoin.php#L40
This condition is not met when $base doesn't have a path and $rel is relative, but it should. Currently working on a fix...


Feature/user profile desktop

Done:

Now displays the correct modal drawer in Profile Component instead of a popup
Profile component now showing up correctly  for desktop version
Edit Profile  now showing up correctly  for desktop version
Edit Account Information component now showing up correctly  for desktop version

@Chimaobi-Johnson , i think we can use what has been done here for https://github.com/FightPandemics/FightPandemics/issues/420

I expected this to be one separate component

and this too but i can refactor it. What do you think? @CeesWang @vikjoshi

Go for it
On Mon, May 25, 2020, 8:06 PM Chimaobi-Johnson<EMAIL_ADDRESS>wrote:

[image: Screenshot (46)]
https://user-images.githubusercontent.com/39125798/82848632-54c6b300-9eec-11ea-9c02-e01cb4723f4f.png
I expected this to be one separate component
[image: Screenshot (47)]
https://user-images.githubusercontent.com/39125798/82848640-6019de80-9eec-11ea-8fa4-adcfba3baf89.png
and this too but i can refactor it. What do you think? @CeesWang
https://github.com/CeesWang @vikjoshi https://github.com/vikjoshi
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/FightPandemics/FightPandemics/pull/455#issuecomment-633747612,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AIAFWLVHVEEEHOL2ZNYXDWDRTMBZBANCNFSM4NI54JDA
.

Go for it
…
On Mon, May 25, 2020, 8:06 PM Chimaobi-Johnson @.***> wrote: [image: Screenshot (46)] https://user-images.githubusercontent.com/39125798/82848632-54c6b300-9eec-11ea-9c02-e01cb4723f4f.png I expected this to be one separate component [image: Screenshot (47)] https://user-images.githubusercontent.com/39125798/82848640-6019de80-9eec-11ea-8fa4-adcfba3baf89.png and this too but i can refactor it. What do you think? @CeesWang https://github.com/CeesWang @vikjoshi https://github.com/vikjoshi — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#455 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AIAFWLVHVEEEHOL2ZNYXDWDRTMBZBANCNFSM4NI54JDA .

okay


No longer work with Luma 9.0 screenshots?

Since screenshots are now sorted by date/time I guess this no longer works right?

not without updating it to support the new screenshot format, which i'll probably do eventually

Can someone compile the pull request (3dsx version) for me? Thank you!

https://github.com/ihaveamac/screenshot-merge/releases/tag/1.4


Redesign Education Page using SVG Animations

Animation Reference
Web View

Mobile View

Additional Reference:
This not exactly what we are aiming here but would give you an idea of the flow
@anushbhatia will help out with the color scheme if required

I wanna do it

I wanna do it

Assigned for 5 days


[python] Use somacore v1.0.8

For @ebezzi
See also https://github.com/single-cell-data/SOMA/releases/tag/python-v1.0.8

This is unfortunately due to some coupling between ExperimentAxisQuery (defined in somacore) and SOMATileDBContext (defined here). https://github.com/single-cell-data/TileDB-SOMA/pull/2001 will fix this issue.

Superseded by #2001


Calibration using ClimateIndicator emissions

As a reminder for further works, it could be useful to have a calibration using the emissions and forcing time series used to update Climate Change Indicators. This basis would allow to estimate future temperature anomaly, concentrations and forcing based on actual emissions, and be more representative. Not urgent, off course.

This is actually in progress already. Some of the historical emissions from updated datasets differ substantially from CMIP6, so getting the emissions to concentration step correct is causing headaches.

Well. Thanks a lot for the answer. I hope this will be available some time. If not, not an issue. I will close this issue in GitHbub, then.


General Post Image preview

Noticed this problems on OSX (but from the other issues, I guess this is also happening on Win)

Existing posts with featured images are not fetching the cover

Adding a feature image doesn't work at all (uploading is never completed).

@primaltutor had the same issue - thanks to both of you for reporting. I sadly can't reproduce the issue... could you do me a giant favor and check for the following:

Hit Cmd/Ctrl + Alt + Shift + I to bring up the developer tools for the currently open Ghost blog. Is there anything in the console that you see?
Is your blog a https or a http blog?
Are you running on Ghost Pro or self-hosted?

This is probably fixed with the mixed content bugfix.


Fix a mix up with AccountSet flags

High Level Overview of Change

rename AccountSetFlags -> AccountSetAsfFlags (this could be considered a breaking change)
add AccountSetTfFlags
update AccountSetFlagInterface to use AccountSetTfFlags
update tests accordingly

Context of Change
AccountSet has two types of flags.

"AccountSet Flags" (prefixed asf), used in SetFlag/ClearFlag field, limited to one per transaction
"AccountSet Transaction Flags" (prefixed tf), used in common Flags field, multiple possible (bit-flags)

(AccountSetAsfFlags are not bit-field flags and therefore do not require a FlagInterface)
Reference:

https://xrpl.org/accountset.html#accountset-flags
https://xrpl.org/transaction-common-fields.html
https://github.com/XRPLF/rippled/blob/develop/src/ripple/protocol/TxFlags.h

Similar to the implementation found in the xrpl.js framework, this PR creates an enum for each type of flag.
Type of Change

[ ] Bug fix (possibly breaking change which fixes an issue)

Test Plan

only ran poetry run poe test_unit
needs better/more testing (and extensive review)

Why is this PR necessary?

Nice catch!
I am in favor of  the tf flags and TX_FLAGS which currently has completely incorrect flags listed. That said I don't think AccountSetFlags needs to be renamed.

Why is this PR necessary?

I think the current implementation is confusing and faulty.
Let me showcase this by example (code take from unit tests)
https://github.com/XRPLF/xrpl-py/blob/v1.7.0/tests/unit/models/transactions/test_better_transaction_flags.py#L20
        actual = models.AccountSet(
            account=ACCOUNT,
            flags=models.AccountSetFlagInterface(
                asf_account_tx_id=True,
                asf_authorized_nftoken_minter=True,
                asf_default_ripple=True,
                asf_deposit_auth=True,
                asf_disable_master=True,
                asf_disallow_xrp=True,
                asf_global_freeze=True,
                asf_no_freeze=True,
                asf_require_auth=True,
                asf_require_dest=True,
            ),
        )

As outlined before there are two kinds of AccountSet flags, the asf and tf flags. The somewhat special asf flags can take integer values from 1 to 10 (these are just numbers and do represent bits). At most one asf flags can be set per transaction.
The above code has several issues:

a FlagInterface essential represent bits;  doing bit operations on asf flags makes no sense
the flags parameter accepts tf transaction flags, assigning the asf gibberish produced with the AccountSetFlagInterface makes even less sense

Nice catch!
I am in favor of the tf flags and TX_FLAGS which currently has completely incorrect flags listed. That said I don't think AccountSetFlags needs to be renamed.

I think the FlagInterface changes are also very much necessary.
In regards to naming. Currently the pattern used throughout the library for naming flags seems to be tx name + 'Flag'. For example:

TrustSetFlag for TrustSet
OfferCreateFlag for OfferCreate

Following that would result in:

AccountSetFlag for the tf transaction flags
AccountSetAsfFlag for the  asf flags (that's the outlier, should probably also get the outlier name)

The only drawback/consideration would have be that we are "switching" the flags that were defined in AccountSetFlag (until now asf).

Assuming this PR moves forward eventually, I will have to make some changes:

someone (@mvadari ?) has to make a decision regarding the enum names (see above)
will need a rebase to resolve some minor conflicts introduced in #522
will need  minor linting fixes

@rikublock would you be able to make those changes now?
@mvadari do you have an opinion on the enum names?

AccountSetFlag for the tf transaction flags
AccountSetAsfFlag for the  asf flags (that's the outlier/special case, should probably also get the outlier name)

I like these names and agree with the logic.

@rikublock would you be able to make those changes now?
I'll take a look at it this week.

As a rough plan of action, I think these changes should be included in xrpl-py 2.0, so I'll take it as an action item today/tomorrow to get the xrpl-py 2.0 branch up to date so we can point it at that branch without a lot of unrelated changes appearing in the changelog :)

I added the outstanding changes and fixes. I also split the commits to make each individual change easier to understand/review.

As a rough plan of action, I think these changes should be included in xrpl-py 2.0, so I'll take it as an action item today/tomorrow to get the xrpl-py 2.0 branch up to date so we can point it at that branch without a lot of unrelated changes appearing in the changelog :)

Sounds good. I agree, it might be best to include this in a major release as the PR contains somewhat breaking changes.

@rikublock Ah, didn't realize you were changing things at the moment - I just was rebasing to try to fix the merge conflicts. It seems I have included all the above commits in the final version. Are there any other changes you were hoping to make before we merge it?

I think I may have misinterpreted the Git history - if there are changes we need to make we can do a follow up PR :)

@JST5000 As far as I am concerned this PR included all the necessary changes.


fromPointToLatLng

added fromPointToLatLng method to GoogleMap and Projection
fixed JavaDoc build error for newer JavaDoc maven plugin

Closing this as it is quite old, combines several unrelated changes (pom.xml, and source code) and contains commented out system out statements.

Please feel free to resubmit changes individually.


Request for more language icons or a description of how a user could add their own

There are a lot of languages which show as a grey question mark in the game activity display such as Assembly (.asm | .S) and Java (.java), it would be nice if these had icons or if instructions on how to add icons for them were included somewhere. Apologies if I'm missing something.

yeah actually you can’t add your own icons because it is relative to the discord application, I will as them as quickly as possible

Hey thanks for responding, I dont understand what you mean when you say I can't add my own icons but then go on to say that you will add them as quickly as possible. I noticed in the repo that they weren't local image files but If you can add them then surely I can?

It is a Discord Application on my account so you can create your app but you will need to add all the icons

I know I'm a bit late to the party, but would it be possible to differentiate the icons of neovim and vim? Just wondering.

You must create another Discord application to do this @jason-shepherd

and just replace the ID in the code


Location search using OpenStreetMap polygons

It's possible to search OpenStreetMap for a "relation", export the OSM XML, then convert it to GeoJSON or WKT for use in GBIF's search.

Go to https://www.openstreetmap.org/ and either search, or use the "🖱?" button to click inside a polygon. For example, Nationalpark Skjoldungernes Land.

At the bottom of the bar on the left is "Download XML", copy the URL.

Add /full to the URL, download.

Use ogr2ogr to convert the OSM XML to GeoJSON:

ogr2ogr -f GeoJSON nps.json nps.xml multipolygons

The other_properties property seems to confuse many GeoJSON libraries (and the portal), as it contains escaped quotes. Delete it:

jq . < nps.json | jq 'del(.features[0].properties.other_tags)' > nps2.json

Put this into a GBIF search. It will probably need to be simplified, so we need to handle large queries or https://github.com/gbif/portal16/issues/553 or https://github.com/gbif/gbif-api/issues/35

Or for the download API:

Use ogr2ogr to convert to WKT in CSV:

ogr2ogr -f CSV sjælland.csv sjælland.xml -lco GEOMETRY=AS_WKT multipolygons

Pull out the WKT

tail -n 1 sjælland.csv | cut -d'"' -f2 > sjælland.wkt

Put this into a GBIF download request.

There is now an example script (really just intended for developer use) here:
https://github.com/gbif/occurrence/blob/master/occurrence-download/example-jobs/download-from-openstreetmap-polygon.sh
We / @MortenHofft can implement this using the public OSM API, but shouldn't go live with it until we've either confirmed the usage is acceptable, or set up an OSM API server.

I'm not entirely sure how to read the issue, but we have in the past talked about it this way:

Label occurrences during ingestion with OSM, GADM, Protected areas, geo regions, political areas etc. The query by point described above seems to support just that.
Query by a string and match that to a geometry for filtering. This would require an API to find geometries by their name. Like 1 this would support the case where users search for an area, but currently only get in free text fields (State province etc)

Ideally 1 would be supplemented with vector tiles for the various layers/geometries.
To me it seems less intersting to click a point to get its enclosing features. Wouldn't it be more useful to search for the feature by name instead (as in 1&2)?


Ignored Mask-SegmentanythingUltraV2 node

Hello everyone,
Why is the mask ignored in the second segmentanythingUltraV2 node?
I will explain the steps in stages so that comments can easily refer to each step.
1)SegementAnythingUltraV2 cuts out the object of my choice
2)I open Mask Editor in preview Bridge node
3)Delete the existing mask (The mask that is displayed in this step does not correspond to the mask that comes from the mask(output) of the first SegementAnythingUltraV2 node)
4)Draw a new mask manually
5)CutbyMask cuts out the unwanted image elements
6)Pass the cut image to the second SegementAnythingUltraV2 node
7)Wondering why the pixels that were actually cut out are back in the image
Overview:

Mask output from the first SegmentAnythingUltra V2:

Mask which I see in the mask editor of the preview bridge:

The output by the preview bridge node still does not contain masks. To include masks, the following can be done:

Hello chflame163,
I build the flow as you suggested.
I think there are two options.
1)I missunderstand what cut by mask means, the way I understand it is that image B dont have the pixels anymore because I cut them out of the image A.
2)The SegmentAnythingUltra V2 node  somehow ignores the cut because image C still have the pixels from A.

Hello chflame163,
I think I understand the cut by mask node better now and the problem is not in the segmentanythingultraV2 node.
Cutbymask crops the image depending on the outermost borders of the white mask area see pictures.
My expectation was that the image coming out of the Node: Cutbymask would match the crop but the node only looks at the outer boundaries of the white mask area and crops it accordingly.
Thanks for your help your node was innocent


As Mary (Persona #1) I want to locate myself so that I only see food recalls that I'm interested in.

Interactions would be along the following lines:

Mary navigates to recall web site (URL?)
Mary enters City/State
Mary enters key words for selected food e.g Lettuce, Ice Cream or ALL


Modifications to BUILD to Use Target libtensorflowlite and make tar.gz

Please make sure that this is a build/installation issue. As per our GitHub Policy, we only address code/doc bugs, performance issues, feature requests and build/installation issues on GitHub. tag:build_template
System information

OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Ubuntu 18.04.3 LTS
Mobile device (e.g. iPhone 8, Pixel 2, Samsung Galaxy) if the issue happens on mobile device:
TensorFlow installed from (source or binary): source
TensorFlow version: tag v2.0.0
Python version: Python 3.6.8
Installed using virtualenv? pip? conda?: from GitHub repository
Bazel version (if compiling from source): Build label: 0.26.0
GCC/Compiler version (if compiling from source): gcc version 7.4.0 (Ubuntu 7.4.0-1ubuntu1~18.04.1)
CUDA/cuDNN version: N/A
GPU model and memory: N/A

Describe the problem
I modified tensorflow/tensorflow/tools/lib_package/BUILD (enclosed). I am trying to build Tensorflow Lite in the same way the Tensorflow C library is built.
bazel build --jobs=1 --local_ram_resources=1024 --config=opt --config=v2 --config=noaws //tensorflow/tools/lib_package:libtensorflow

Final output:
Target //tensorflow/tools/lib_package:libtensorflow up-to-date:
  bazel-bin/tensorflow/tools/lib_package/libtensorflow.tar.gz

I'd like to do the same for Tensorflow Lite.
Provide the exact sequence of commands / steps that you executed before running into the problem

Compiled Tensorflow C package using bazel build --jobs=1 --local_ram_resources=1024 --config=opt --config=v2 --config=noaws //tensorflow/tools/lib_package:libtensorflow
Modified tensorflow/tensorflow/tools/lib_package/BUILD.
Compiled Tensorflow Lite using bazel build --jobs=1 --local_ram_resources=1024 --config=opt --config=v2 --config=noaws //tensorflow/lite:libtensorflowlite.so.
The archive libtensorflowlite.tar.gz is not produced.
Tried bazel build --jobs=1 --local_ram_resources=1024 --config=opt --config=v2 --config=noaws //tensorflow/lite:libtensorflowlite.so but got the error

ERROR: Skipping '//tensorflow/lite:libtensorflowlite': no such target '//tensorflow/lite:libtensorflowlite': target 'libtensorflowlite' not declared in package 'tensorflow/lite' (did you mean 'libtensorflowlite.so'?) defined by /mnt/drive/stuff/src/tensorflow/tensorflow/lite/BUILD
WARNING: Target pattern parsing failed.
ERROR: no such target '//tensorflow/lite:libtensorflowlite': target 'libtensorflowlite' not declared in package 'tensorflow/lite' (did you mean 'libtensorflowlite.so'?) defined by /mnt/drive/stuff/src/tensorflow/tensorflow/lite/BUILD
INFO: Elapsed time: 0.279s
INFO: 0 processes.
FAILED: Build did NOT complete successfully (0 pac\
kages loaded)

I am happy to turn this into a PR.
Any other info / logs
Include any logs or source code that would be helpful to diagnose the problem. If including tracebacks, please include the full traceback. Large logs and files should be attached.
N/A
BUILD.zip

Apologies! My change worked. I found libtensorflowlite.tar.gz in bazel-bin/tensorflow/tools/lib_package/. I'll fork, push, and make a PR.

Apologies! My change worked. I found libtensorflowlite.tar.gz in bazel-bin/tensorflow/tools/lib_package/.

@dtsmith2001,
Any updates regarding this? Please feel free to close the issue if resolved. Thanks!

@amahendrakar Sorry, I got diverted. Let me look into this today.

No time to work on this. Closing.


Inline :style with value 0 ignored

Vue.js version
2.0.0-rc.8
Reproduction Link
https://jsfiddle.net/Lcp6zekn/
Steps to reproduce
Add a style attribute with value 0, e.g.

 or

.
What is Expected?
The value is respected.
What is actually happening?
The value is ignored.

Works in 1.x, which is interesting. https://jsfiddle.net/2mnyqnnt/
In 2.0, I've found that I've had to turn Falsy values into strings or Vue will not apply the attribute. (is this expected in 2.0?) In this case, it's not applying the style attribute for opacity:0.
Similar issues here with an aria attribute that has a boolean value e.g. aria-invalid="boolean"


Mmg 5.7.3 CMake configuration is broken

The CMake configuration is broken in mmg 5.7.3 since it looks for VTK even when mmg was not compiled with mmg support.
There is a fix in the main branch (https://github.com/MmgTools/mmg/pull/267) but it has been included in a new release yet.
Would it me possible to release mmg 5.7.2 in the meantime ?

Hi, I think there is still some work to be done for the 5.7.2 (tests in some environments not passing yet) :
https://github.com/conda-forge/mmgsuite-feedstock/pull/6


324 akka dispatcher total threads active threads

Closes #323 #324

Summary:
add dispatcher metrics:

static max threads config
static min threads config
static parallelism config
active thread count
total thread count

@ornel-lloyd-edano please also update this branch and resolve the conflicts


Error while running the training part.. TypeError: resize_images() got an unexpected keyword argument 'preserve_aspect_r atio'

Hello Sir, When i try to train it, it throws the following errors.. Please help me with the solution.
(tensorflow1) C:\Tensorflow1\models\research\object_detection>python train.py --
logtostderr --train_dir=training/ --pipeline_config_path=training/faster_rcnn_in
ception_v2_pets.config
WARNING:tensorflow:From C:\Users\OFR\Anaconda3\envs\tensorflow1\lib\site-package
s\tensorflow\python\platform\app.py:124: main (from main) is deprecated and
will be removed in a future version.
Instructions for updating:
Use object_detection/model_main.py.
WARNING:tensorflow:From C:\tensorflow1\models\research\object_detection\legacy\t
rainer.py:266: create_global_step (from tensorflow.contrib.framework.python.ops.
variables) is deprecated and will be removed in a future version.
Instructions for updating:
Please switch to tf.train.create_global_step
WARNING:tensorflow:num_readers has been reduced to 1 to match input file shards.
Traceback (most recent call last):
File "train.py", line 184, in
tf.app.run()
File "C:\Users\OFR\Anaconda3\envs\tensorflow1\lib\site-packages\tensorflow\pyt
hon\platform\app.py", line 124, in run
_sys.exit(main(argv))
File "C:\Users\OFR\Anaconda3\envs\tensorflow1\lib\site-packages\tensorflow\pyt
hon\util\deprecation.py", line 136, in new_func
return func(*args, **kwargs)
File "train.py", line 180, in main
graph_hook_fn=graph_rewriter_fn)
File "C:\tensorflow1\models\research\object_detection\legacy\trainer.py", line
291, in train
clones = model_deploy.create_clones(deploy_config, model_fn, [input_queue])
File "C:\tensorflow1\models\research\slim\deployment\model_deploy.py", line 19
3, in create_clones
outputs = model_fn(*args, **kwargs)
File "C:\tensorflow1\models\research\object_detection\legacy\trainer.py", line
186, in _create_losses
resized_image, true_image_shape = detection_model.preprocess(image)
File "C:\tensorflow1\models\research\object_detection\meta_architectures\faste
r_rcnn_meta_arch.py", line 543, in preprocess
parallel_iterations=self._parallel_iterations)
File "C:\tensorflow1\models\research\object_detection\utils\shape_utils.py", l
ine 237, in static_or_dynamic_map_fn
outputs = [fn(arg) for arg in tf.unstack(elems)]
File "C:\tensorflow1\models\research\object_detection\utils\shape_utils.py", l
ine 237, in
outputs = [fn(arg) for arg in tf.unstack(elems)]
File "C:\tensorflow1\models\research\object_detection\core\preprocessor.py", l
ine 2264, in resize_to_range
lambda: _resize_portrait_image(image))
File "C:\Users\OFR\Anaconda3\envs\tensorflow1\lib\site-packages\tensorflow\pyt
hon\util\deprecation.py", line 316, in new_func
return func(*args, **kwargs)
File "C:\Users\OFR\Anaconda3\envs\tensorflow1\lib\site-packages\tensorflow\pyt
hon\ops\control_flow_ops.py", line 1894, in cond
orig_res_t, res_t = context_t.BuildCondBranch(true_fn)
File "C:\Users\OFR\Anaconda3\envs\tensorflow1\lib\site-packages\tensorflow\pyt
hon\ops\control_flow_ops.py", line 1752, in BuildCondBranch
original_result = fn()
File "C:\tensorflow1\models\research\object_detection\core\preprocessor.py", l
ine 2263, in
lambda: _resize_landscape_image(image),
File "C:\tensorflow1\models\research\object_detection\core\preprocessor.py", l
ine 2245, in _resize_landscape_image
align_corners=align_corners, preserve_aspect_ratio=True)
TypeError: resize_images() got an unexpected keyword argument 'preserve_aspect_r
atio'
Please Help me to solve this problem. :(

I was able to get past this error by commenting out that argument in models\research\object_detection\corepreprocessor.py. My training is still running so I'm not sure what if any effect this will have so this may or may not be an actual solution. See issue #258 for details (looks to be the same issue as this).

Did your model work properly? @monocongo

Yes, it seems so, see the attached image of my TensorBoard output for the model that's been running for about 16 hours now. Soon I will check to see how well the trained model performs as a detector for the class of objects I've trained it for.

Thanks a lot.. mine is also training after some modification.. I was using the old repository which was used for the tutorial so i had to change many thing and finally its working ^_^ hope for the best.

@monocongo I trained my model well enough with good total loss and all but when i am about to create frozen inference graph it takes too short time to create it and it gives me horribly wrong detection result.
When i create frozen inference graph, it shows following message----
"Creating new thread pool with default inter op setting: 4. Tune using inter_op_
parallelism_threads for best performance.
May i know which version of CUDA, CUDNN, Tensorflow, Tensorflow-gpu you are using???
And are you using the latest tensorflow/model repository or any old version as used in the tutorial?
Thanks in advance.

@OmorFarukRakib I do not have access to a GPU at the moment so I'm only using the CPU version. My model appears to have trained OK but I have yet to be able to test it since I am now seeing this error:
  File "C:\home\miniconda\envs\scw\lib\site-packages\tensorflow\python\framework\importer.py", line 283, in import_graph_def
    raise ValueError('No op named %s in defined operations.' % node.op)
ValueError: No op named GatherV2 in defined operations.

So I apologize I can't help you much, as I don't have too much more success than you do so far.  :(

Hi @monocongo and @OmorFarukRakib , I also just ran in to this issue. Thanks for working to figure it out! Like @monocongo suggested, you can remove the preserve_aspect_ratio=True argument where it errors out in the \object_detection\core\preprocessor.py file. I just tried this and it seems to be working.
I will close this issue once I confirm that my model runs correctly with this fix.

Thank you @EdjeElectronics for replying. I also solved that problem, thanks to @monocongo . I did everything as instructed in the tutorial but my detection result is horrible. I got many errors through out the processes but able to solve them all but now i have zero idea what i did wrong.. I tried two times and detection result is same and horrible.
Do you have any clue why might it be happening? :(
N.B: I am using my CPU to train and i am using the old model repository that you used for your tutorial.

Hello @EdjeElectronics  Could you please share your model.ckpt-53698.meta file or the whole training folder? I think my inference graph is not being created properly. I would check whether my model is broken or the inference graph.
Thanks again.

@monocongo : I could not seem to find the coreprocessor.py

Hi @monocongo and @OmorFarukRakib , I also just ran in to this issue. Thanks for working to figure it out! Like @monocongo suggested, you can remove the preserve_aspect_ratio=True argument where it errors out in the \object_detection\core\preprocessor.py file. I just tried this and it seems to be working.
I will close this issue once I confirm that my model runs correctly with this fix.

how you deleted that line preserve_aspect_ratio=true??? or you changed it to preserve_aspect_ratio=false? please tell me because my training is not done yet

you can remove the preserve_aspect_ratio=True argument where it errors out in the \object_detection\core\preprocessor.py file.
so did you comment it out, remove it completely > I am currently getting errors on this
Please show the final script of code for the function
def _resize_portrait_image(image):
# resize a portrait image
return tf.image.resize_images(
    image, tf.stack([max_dimension, min_dimension]), method=method,
    align_corners=align_corners, preserve_aspect_ratio=True)

After i remove  preserve_aspect_ratio=True i get this error.
AttributeError: module 'tensorflow' has no attribute 'init_scope'

What version of Tensorflow are you using? Try upgrading to 1.12, worked for me.

OmorFarukRakib can you explain me please what did you do to run the train , i got the same issue :( and i am stuck

@OmorFarukRakib can you explain me please what did you do to run the train , i got the same issue :( and i am stuck

@Yagamilighto4
There was no preserve_aspect_ratio argument in TF 1.9.0. Apparently you are using old TF version with newer object detection API version. Update your TF to the most recent 1.x version.


Add missing GSoC logo

Signed-off-by: Karol Gugala<EMAIL_ADDRESS>

@mithro This looks good to merge to me. You have write access?


VolumeViewport setProperties

Similar to StackViewports which can .setProperties, Volume Viewport should too
currently for stack viewports
viewport.setProperties({ voiRange: ctVoiRange });

But for volume viewports
// Get the volume actor from the viewport
const actor = viewport.getActor(volumeId);

// Set the mapping range of the actor to a range to highlight bones
actor.volumeActor
  .getProperty()
  .getRGBTransferFunction(0)
  .setMappingRange(-1500, 2500);

viewport.render();

@sedghi  I found that this will update the Volume properties without using the VTK functions:
const { lower, upper } = csUtils.windowLevel.toLowHighRange(
    windowWidthNum,
    windowLevelNum
);

viewport.setProperties({ voiRange: { upper, lower }, volumeActor }, referenceId);

viewport.render();

Correct this was an old issue


Remove Facebook link for each event

I think we should remove the facebook icon/link from each event. We cannot post links to every social media we hold for each event.
Let's just hold the meetup link and the GitHub folder of the specific meetup.

Should we remove the relevant data or just comment out the fb icon/link from the template?

Probably both @kouts . It's not a bit deal after all.


print analytics on our is_uncertain_prediction set

should be as simple as .describe()

ooh, and print it on our predicted values as well

done.


broker prometheus metrics export fails when bookie is launched by the broker

Expected behavior
in our setting, the bookeeper was started at the same time as the broker with:
% bin/pulsar broker --run-bookie --run-bookie-autorecovery
and I was able to get bookkeeper metrics on
'http://pulsar-node-1.mydomain.net:8000/metrics'
and I should had been able to get metrics from the broker too here :
http://pulsar-node-1.mydomain.net:8080/metrics
Actual behavior
The following exception is raised at every request of the broker metrics.
Jan 24 06:25:02 pulsar-node-1 pulsar[22776]: 06:25:02.139 [pulsar-web-59-8] INFO  org.eclipse.jetty.server.RequestLog - <IP_ADDRESS> - - [24/Jan/2020:06:25:02 +0100] "GET /metrics HTTP/1.1" 302 0 "-" "Prometheus/2.1.0+ds" 0
Jan 24 06:25:02 pulsar-node-1 pulsar[22776]: 06:25:02.139 [prometheus-stats-68-1] ERROR org.apache.bookkeeper.common.util.SafeRunnable - Unexpected throwable caught
Jan 24 06:25:02 pulsar-node-1 pulsar[22776]: java.lang.NoClassDefFoundError: Could not initialize class org.apache.pulsar.broker.stats.prometheus.PrometheusMetricsGenerator
Jan 24 06:25:02 pulsar-node-1 pulsar[22776]: #011at org.apache.pulsar.broker.stats.prometheus.PrometheusMetricsServlet.lambda$doGet$0(PrometheusMetricsServlet.java:70) ~[org.apache.pulsar-pulsar-broker-2.4.2.jar:2.4.2]
Jan 24 06:25:02 pulsar-node-1 pulsar[22776]: #011at org.apache.bookkeeper.mledger.util.SafeRun$1.safeRun(SafeRun.java:32) ~[org.apache.pulsar-managed-ledger-original-2.4.2.jar:2.4.2]
Jan 24 06:25:02 pulsar-node-1 pulsar[22776]: #011at org.apache.bookkeeper.common.util.SafeRunnable.run(SafeRunnable.java:36) [org.apache.bookkeeper-bookkeeper-common-4.9.2.jar:4.9.2]
Jan 24 06:25:02 pulsar-node-1 pulsar[22776]: #011at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_232]
Jan 24 06:25:02 pulsar-node-1 pulsar[22776]: #011at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_232]
Jan 24 06:25:02 pulsar-node-1 pulsar[22776]: #011at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [?:1.8.0_232]
Jan 24 06:25:02 pulsar-node-1 pulsar[22776]: #011at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [?:1.8.0_232]
Jan 24 06:25:02 pulsar-node-1 pulsar[22776]: #011at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_232]
Jan 24 06:25:02 pulsar-node-1 pulsar[22776]: #011at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_232]
Jan 24 06:25:02 pulsar-node-1 pulsar[22776]: #011at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) [io.netty-netty-all-4.1.32.Final.jar:4.1.32.Final]
Jan 24 06:25:02 pulsar-node-1 pulsar[22776]: #011at java.lang.Thread.run(Thread.java:748) [?:1.8.0_232]
Jan 24 06:25:02 pulsar-node-1 pulsar[22776]: 06:25:02.141 [pulsar-web-59-7] INFO  org.eclipse.jetty.server.RequestLog - <IP_ADDRESS> - - [24/Jan/2020:06:24:32 +0100] "GET /metrics/ HTTP/1.1" 500 331 "http://pulsar-node-1.mydomain.net:8080/metrics" "Prometheus/2.1.0+ds" 30000
Note that it's bookkeeper which is complaining that it can't found 'org.apache.pulsar.broker.stats.prometheus.PrometheusMetricsGenerator', which is a class from the broker.
The 8080 port is the default port for the bookkeeper httpServerPort, so it's probably hiding the prometheus export. Unfortunatly, we can't change the prometheus port in the broker configuration.
If both the bookie and the broker are launched separately, then both metrics are correctly exposed.
Steps to reproduce
Start the bookie along the broker and request the broker metric.
System configuration
Pulsar version: 2.4.2

@gfexensa  right. This is because bookie/broker using the same  port of 8000 for prometheus.

@gfexensa right. This is because bookie/broker using the same port of 8000 for prometheus.

The broker use a different port 8000 to expose its metrics than bookkeeper (8080). Its the bookkeeper httpServerPort which share the same port as the broker prometheus metrics.
it should work if the httpServerPort is modified, but it's not exactly a desirable solution. IMHO, both broker prometheus port and bookkeeper http server port should be different, and eventually allows to specify a different broker port for prometheus.

Closed as stale. Please create a new issue if it's still relevant to the maintained versions.


fix: unnecessary new line

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Oh, just found out that this already fixed by #462.


Kourier is not compatible with Knative-Service timeoutSeconds custom value with more than 300 seconds

When a long GRPC connection is established, the data does not return within 5 minutes, and the connection will be interrupted, which can be solved by adjusting the timeoutSeconds parameter. However, when kourier is used as a gateway, the timeoutSeconds value is fixed to 300 seconds by default and cannot be customized.
In use, it is found that in kourier v0.26.0 version, kourier does not support the custom parameter of timeoutSeconds in Knative-Service.
Also does not support, the max-revision-timeout-seconds and revision-timeout-seconds custom parameters in knative-serving comfigmap config-defaults.
apiVersion: serving.knative.dev/v1
kind: Service
metadata:
  name: test
spec:
  template:
    metadata:
      annotations:
        autoscaling.knative.dev/class: kpa.autoscaling.knative.dev
        autoscaling.knative.dev/metric: concurrency
        autoscaling.knative.dev/minScale: "0"
        autoscaling.knative.dev/maxScale: "1"
    spec:
      timeoutSeconds: 600   # kourier gw is not compatible with this custom number.
      containers:
      - image: imageurl
        imagePullPolicy: IfNotPresent
        ports:
          - name: h2c
            containerPort: 8080

Reminder: Istio gateway is compatible with timeoutSeconds custom value.

/good-first-issue
Yeah, other ingresses have the stream_idle_timeout without any limit.

We should allow the stream_idle_timeout configuration via config-kourier.
[TBD] Set no limit by default. (TBD as it may affect on the current users.)
[TBD] Add conformance test with long timeout like https://github.com/nak3/serving/pull/27 or networking conformance.

/assign xxinran


Active tasks

+1 - merge after fixing the two minor nits.
thanks again!

Thanks for all the help @robertkowalski. Its now merged in.

Merged.


Allow passing with_drafts param to get_expanded_links

This commit allows the new with_drafts param to be passed to get_expanded_links for publishing-api. Depends on https://github.com/alphagov/publishing-api/pull/831.
Trello: https://trello.com/c/LmVHv7Jv/537-build-design-for-tagging-to-draft-taxons-in-whitehall

This isn't required any more since we're taking a different approach in https://github.com/alphagov/publishing-api/pull/833.

We have gone back to the approach in https://github.com/alphagov/publishing-api/pull/831 so this is needed again.
I've added the param to the test helper as well.

Some context, the idea is that we request expanded links twice, one request without drafts and one with drafts. Then we can process the difference, e.g.
without_drafts = Services.publishing_api.get_expanded_links("c58fdadd-7743-46d6-9629-90bb3ccc4ef0", with_drafts: false)
with_drafts = Services.publishing_api.get_expanded_links("c58fdadd-7743-46d6-9629-90bb3ccc4ef0", with_drafts: true)

diffe = with_drafts["expanded_links"]["child_taxons"] - without_drafts["expanded_links"]["child_taxons"]

=>  [
  {
  "analytics_identifier"=>nil,
  "api_path"=>"/api/content/education/something",
  "base_path"=>"/education/something",
  "content_id"=>"a544d48b-...",
  ...
  "links"=> {
    "parent_taxons"=>[
      {
        "analytics_identifier"=>nil,
        "api_path"=>"/api/content/education",
        "base_path"=>"/education",
        "content_id"=>"c58fdadd-7743-46d6-9629-90bb3ccc4ef0",
        "description"=>"Early years learning, schools and academies, further and higher education, skills and vocational training, student funding.",
        "document_type"=>"taxon",
        "locale"=>"en",
        "public_updated_at"=>"2017-02-22T17:38:19Z",
        "schema_name"=>"taxon",
        "title"=>"Education, training and skills",
        "withdrawn"=>false,
        "details"=> {
          "internal_name"=>"education, training and skills", "notes_for_editors"=>""},
          "links"=>{}
        }
      ]
    }
  },
  ...
]


Feature: add http2 transport

Codecov Report

Merging #104 into master will decrease coverage by 2.35%.
The diff coverage is 20.1%.

@@            Coverage Diff             @@
##           master     #104      +/-   ##
==========================================
- Coverage   83.19%   80.84%   -2.36%
==========================================
  Files          52       53       +1
  Lines        3738     3853     +115
  Branches      759      780      +21
==========================================
+ Hits         3110     3115       +5
- Misses        557      646      +89
- Partials       71       92      +21

Impacted Files
Coverage Δ

src/transports/udp.js
90.32% <ø> (+11.1%)
:arrow_up:

src/transports/mux.js
90.47% <ø> (+6.95%)
:arrow_up:

src/transports/h2.js
0.82% <0.82%> (ø)

src/proxies/socks.js
73.24% <100%> (ø)
:arrow_up:

src/transports/defs.js
81.25% <100%> (+3.12%)
:arrow_up:

src/core/mux-relay.js
94.8% <100%> (ø)
:arrow_up:

src/core/config.js
86% <100%> (ø)
:arrow_up:

src/core/acl.js
63.18% <100%> (ø)
:arrow_up:

src/core/relay.js
84.33% <32.35%> (-13.48%)
:arrow_down:

src/core/hub.js
84.75% <58.82%> (-1.97%)
:arrow_down:

... and 5 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update aa71a71...2b3cdf7. Read the comment docs.


Error with Minmax normalization

I changed output_feature_normalisation to MINMAX and got following error:
MINMAX.dat Traceback (most recent call last):   File "/data/thinhnv20/Projects/merlin-master-magphase/src/run_merlin.py", line 1270, in <module>     main_function(cfg)   File "/data/thinhnv20/Projects/merlin-master-magphase/src/run_merlin.py", line 725, in main_function     feature_std_vector = numpy.array(global_std_vector[:,feature_index:feature_index+cfg.out_dimension_dict[feature_name]], 'float32') UnboundLocalError: local variable 'global_std_vector' referenced before assignment
This issue same like #236  But no one resolved it.

You could try adding the necessary conditions on cfg.output_feature_normalisation L775 (within NORMCMP and if not cfg.GenTestList). Currently this part of the code assumes that MVN would have been used, and doesn't account for MINMAX
https://github.com/CSTR-Edinburgh/merlin/blob/master/src/run_merlin.py#L775


Building vite on windows all licenses removed

Seems the licences are not loaded:
Error: Cannot find module 'vary\package.json' from 'F:\work\projects\quini\GitHub\vite\packages\vite'
    at Function.resolveSync [as sync] (F:\work\projects\quini\GitHub\vite\node_modules\.pnpm\resolve@1.20.0\node_modules\resolve\lib\sync.js:102:15)
    at F:\work\projects\quini\GitHub\vite\packages\vite\rollup.config.js:349:27
    at Array.map (<anonymous>)
    at thirdParty (F:\work\projects\quini\GitHub\vite\packages\vite\rollup.config.js:317:10)
    at LicensePlugin.scanThirdParties (F:\work\projects\quini\GitHub\vite\node_modules\.pnpm\rollup-plugin-license@2.5.0_rollup@2.57.0\node_modules\rollup-plugin-license\dist\index.js:1022:7)
    at Object.generateBundle (F:\work\projects\quini\GitHub\vite\node_modules\.pnpm\rollup-plugin-license@2.5.0_rollup@2.57.0\node_modules\rollup-plugin-license\dist\index.js:1386:14)
    at F:\work\projects\quini\GitHub\vite\node_modules\.pnpm\rollup@2.57.0\node_modules\rollup\dist\shared\rollup.js:22620:25
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (node:internal/process/task_queues:94:5) {
  code: 'MODULE_NOT_FOUND'
}

@userquin Vite now uses resolve v1.22.0, which may have solved this. I don't have a windows machine locally, but I'm wondering if this has been fixed for you.

@userquin Vite now uses resolve v1.22.0, which may have solved this. I don't have a windows machine locally, but I'm wondering if this has been fixed for you.

I'll try it this afternoon and I'll close this issue if it's solved

build on Windows 10 doesn't remove the licenses


Improving file names and tut file titles

Current coverage is 89.80% (diff: 100%)

Merging #85 into master will not change coverage

@@             master        #85   diff @@
==========================================
  Files            25         25
  Lines           471        471
  Methods         464        464
  Messages          0          0
  Branches          7          7
==========================================
  Hits            423        423
  Misses           48         48
  Partials          0          0

Powered by Codecov. Last update 98e5a4e...7e12d48

What about having titles in sync between SUMMARY.md and tut files?

@OlivierBlanvillain Just updated the docs to have the same titles as in the Summary (makes perfect sense). Now if you feel that any of the titles can be improved feel free to directly add a commit to the PR or let me know and I can do it; whichever is easier for you. thanks!

LGTM!


Keyboard Manager not remapping 80% of shortcuts since last week

Microsoft PowerToys version
0.51.1
Running as admin

[X] Yes

Area(s) with issue?
Keyboard Manager
Steps to reproduce
Start up computer and try the shortcuts that I have, they should work. Wait 20 minutes or so and the indicated ones stop working.
✔ Expected Behavior
Remaps shortcuts.
❌ Actual Behavior
No effect.
Other Software
I am using the iris keyboard which has a microcontroller on it which I can flash a custom layout to it which I did. But keyboard manager has been working fine for the past 6 months I had this keyboard with it. Just in the past week the following shortcuts marked as red have not been working since a little while after the computer is booted up (20 minutes after as I write this) :

I had the previous version or the 2nd previous one installed and this problem happened. I updated it a few days ago to the latest and the problem persists. The problem occurs a little while after my computer is running, about 20 minutes just now. I have closed powertoys, clicked exit from the system tray, and searched it in the start menu and restarted it, doesn't fix it.
I have not installed any new programs in the last week except Logitech G Hub. But I don't see how it would conflict, it has no keyboard shortcuts. I had it installed a year ago and both worked fine. I did exit both G Hub and powertoys and then launched just powertoys but same issue. I will try uninstalling G Hub and try but I doubt it is causing any issues. Odd how some shortucts work and some don't.
Log file: PowerToysReport_2021-12-26-14-17-13.zip
Edit: So it's been 5 hours since this post and my computer has been on the whole time, and all shortcuts work. I don't know when they started working since. Logitech G Hub is open in the system tray so no conflict there.
Second log file:
PowerToysReport_2021-12-26-20-07-02.zip
Edit 2: 1 hour after the previous edit, original issue has resurfaced, same keys not working. Did not change anything, am surfing the web as before. Another log file:
PowerToysReport_2021-12-26-21-03-25.zip
Edit 3: So 2 days after, right now I've been using my pc for 7 hours and it works fine right now.
Edit 4: Since 2 days after making this post, keyboard manager working fine for 4 days now. Odd, will close this for now then.

What caused you to close the issue

Problem stopped occurring for a few days
On Sat., Jan. 1, 2022, 11:22 p.m. Clint Rutkas, @.***>
wrote:

What caused you to close the issue
—
Reply to this email directly, view it on GitHub
https://github.com/microsoft/PowerToys/issues/15167#issuecomment-1003661887,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AQF3ZKXBABTKQ3GWG7NJLPDUT7HJVANCNFSM5KZG62ZQ
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
You are receiving this because you modified the open/close state.Message
ID: @.***>

The issue has resurfaced and I updated to latest version just now, same issue. Been on computer for hours.

Can you confirm this issue is still relevant in v0.73? /needinfo

Haven't faced this issue in a long time, same shortcuts work perfectly


doc: add proposal template.

Ⅰ. Describe what this PR does
add proposal template doc.
II. Does this pull request fix one issue?

NONE
III. Special notes for reviewers if any.

Codecov Report

Merging #162 (5205bf0) into master (716c1a5) will not change coverage.
The diff coverage is n/a.

:exclamation: Current head 5205bf0 differs from pull request most recent head d92c314. Consider uploading reports for the commit d92c314 to get more accurate results

@@           Coverage Diff           @@
##           master     #162   +/-   ##
=======================================
  Coverage   21.74%   21.74%
=======================================
  Files          73       73
  Lines        4374     4374
=======================================
  Hits          951      951
  Misses       3292     3292
  Partials      131      131

Flag
Coverage Δ

unittests
21.74% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 716c1a5...d92c314. Read the comment docs.


0.7.5 update

I've updated the code so that it works with version 0.7.5 of Crystal, as well as make the tests green again.

Oh, thanks, currently I have not access to the computer


ha-modbus-proxy reporting depricated function

loop-Argument is depricated since Python 3.8 and will be removed in Python 3.10
right now, the addon is still working... but it might cause issues when switching to Py3.10
2022-10-15 22:54:31,735     INFO modbus-proxy: Starting...
2022-10-15 22:54:31,737  WARNING py.warnings: /usr/lib/python3.9/asyncio/base_events.py:1460: DeprecationWarning: The loop argument is deprecated since Python 3.8, and scheduled for removal in Python 3.10.
  infos = await tasks.gather(*fs, loop=self)
2022-10-15 22:54:31,740  WARNING py.warnings: /usr/lib/python3.9/asyncio/base_events.py:1518: DeprecationWarning: The loop argument is deprecated since Python 3.8, and scheduled for removal in Python 3.10.
  await tasks.sleep(0, loop=self)

I haven't seen this error running another modbus-proxy on a proxmox lxc...  therefore, not sure, if this might be an issue in the original modbus-proxy, too

@ChristophCaina there is no loop code in the modbus proxy. the message comes from the asyncio dependency. i hope they fix it on their side


Direct deploy to Azure Container Instance

Hi,
is it possible to use the navcontainerhelper to directly deploy to a new Azure Container Instance?

No, not at this time.

Currently facing some multi environment testing that this feature would help with, so adding my voice for this requirement.

I am using Azure VMs with traefik, which allows you to have any number of containers running isolation mode on a VM accessible from outside automatically.
and you can run powershell and containerhelper on the vm.
Blog post coming up.

The problem with using Azure VMs is the high price and relatively high maintenance amount compared to using Azure Container Instances so it would be really helpful if the navcontainerhelper could directly deploy to ACIs.

Not sure you have calculated the ACI pricing correctly.
it is $0.0000135 a second per vCPU, which is $35 a month.

$0.0000015 a second per GB, which is $4 a month.

a VM with 4 vCPU machine and 16GB is $128 a month.
the same ACI is $204
In the VM you could host some containers and share the memory/CPUs - the ACI you should at least have 2 vCPU and 8GB per container.
The VM can even be shut down at night which would cut the price in half - ACI's could do the same - but they loose everything on shutdown.
This is actually the reason why I decided not to follow this path - it is too expensive for the need we have.

And BTW - ACIs are really designed as build containers for various build tasks. The issue however is that the BC images are fairly large and it takes a long time to download (and you pay for that time).
I might work on allowing ACIs for build if I can get the ACI team to cache the latest and current BC images.

Thanks for the insight, very appreciated.
However, Microsoft view of only supporting the last 2 releases, which I definitely adopt when possible, is not realistic for smaller companies like us. As long as OnPrem users exists, we will need to support them, therefore having an easy access to the images for hotfixes.
Therefore, our way to go will probably to have our own build machine that will cache the images. I may talk quickly and generalise our case, but I guess it reduces the intensive of you lobbying for this feature, saving you a bit of time.
Best,
Cyrille
From: Freddy Kristiansen<EMAIL_ADDRESS>Sent: 18 October 2019 15:55
To: microsoft/navcontainerhelper<EMAIL_ADDRESS>Cc: Cyrille Rougeau<EMAIL_ADDRESS>Comment<EMAIL_ADDRESS>Subject: Re: [microsoft/navcontainerhelper] Direct deploy to Azure Container Instance (#670)
And BTW - ACIs are really designed as build containers for various build tasks. The issue however is that the BC images are fairly large and it takes a long time to download (and you pay for that time).
I might work on allowing ACIs for build if I can get the ACI team to cache the latest and current BC images.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHubhttps://github.com/microsoft/navcontainerhelper/issues/670?email_source=notifications&email_token=AJKRMZCBJL32KVSV5KYVGP3QPHE2NA5CNFSM4JBG6GVKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEBUXUNI#issuecomment-543783477, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AJKRMZGBEP4SQDBGQR2OK6TQPHE2NANCNFSM4JBG6GVA.

Yep, thanks
Fortunately you can have onprem build agents - or online - a palette of options (which also requires people to investigate and decide:-))


Add support for building extensions using MinGW compilers

See individual commits for details on what this PR changes.
A new version of https://github.com/pypa/distutils/pull/78
Fixes https://github.com/pypa/distutils/issues/34
cc @lazka

I notice there are conflicts. I tried to resolve the conflicts, but I don't seem to have access to the fork, so I've pushed a couple of commits to the add-mingw-support-jaraco branch, resolving the conflict. Feel free to pull those changes in.

Thanks, I would be able to work on this later this week.

See individual commits for details on what this PR changes.
A new version of https://github.com/pypa/distutils/pull/78
Fixes https://github.com/pypa/distutils/issues/34
cc @lazka

@naveen521kk What is the status of this PR? I've been switching to PDM for a lot of my work, and installing a number of packages break with the good ol' --plat-name must be one of ('win32', 'win-amd64', 'win-arm32', 'win-arm64') error.
Since the workaround is going away, soon this means I won't be able to install packages anymore.

@naveen521kk What is the status of this PR? I've been switching to PDM for a lot of my work, and installing a number of packages break with the good ol' --plat-name must be one of ('win32', 'win-amd64', 'win-arm32', 'win-arm64') error.

Hey, I'm sorry, I kinda forgot about this PR. I'll spend some time this week week to get this working.

@naveen521kk

Hey, I'm sorry, I kinda forgot about this PR.

No worries, I'm kinda happy you responded at all, tbh.

I'll spend some time this week to get this working.

Excellent, tyvm. I'm happy to test locally, although I'm not sure how I would replace the vendored version in my Python with this version for testing purposes. Right now I'm still pip installing pdm from the source tree b/c of the --plat-name errors (it works otherwise fine). Will be interested in whether this allows installing pdm from PyPI to succeed.

Should we also include https://github.com/msys2-contrib/cpython-mingw/pull/157 ?

Should we also include https://github.com/msys2-contrib/cpython-mingw/pull/157 ?

I think so, I'll include them.

This PR is ready for review!

Hey, @jaraco it's been quite long, can you review this PR?

I've resolved the conflicts and I'd like to test the changes, but GitHub is rejecting me pushing the resolution.
 distutils add-mingw-support @ git push
fatal: The upstream branch of your current branch does not match
the name of your current branch.  To push to the upstream branch
on the remote, use

    git push origin HEAD:refs/pull/184/head

To push to the branch of the same name on the remote, use

    git push origin HEAD

To avoid automatically configuring an upstream branch when its name
won't match the local branch, see option 'simple' of branch.autoSetupMerge
in 'git help config'.

 distutils add-mingw-support [128] @ git push origin HEAD:refs/pull/184/head
Enumerating objects: 99, done.
Counting objects: 100% (99/99), done.
Delta compression using up to 12 threads
Compressing objects: 100% (66/66), done.
Writing objects: 100% (68/68), 10.07 KiB | 10.07 MiB/s, done.
Total 68 (delta 51), reused 0 (delta 0), pack-reused 0 (from 0)
remote: Resolving deltas: 100% (51/51), completed with 25 local objects.
To https://github.com/pypa/distutils
 ! [remote rejected]     HEAD -> refs/pull/184/head (deny updating a hidden ref)
error: failed to push some refs to 'https://github.com/pypa/distutils'

I'm not sure what "deny updating a hidden ref" means. I've pushed the commit (1b38bc903) to the add-mingw-support branch to see if tests pass.

That failed because there was a latent reference to setup.cfg. Corrected in 416ef6a75.

And another revision to replace testing with test. 5fb38a1e1.

Tests are now failing during collection:
______________ ERROR collecting distutils/tests/test_install.py _______________
ImportError while importing test module 'D:/a/distutils/distutils/distutils/tests/test_install.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
distutils/tests/test_install.py:16: in <module>
    from distutils.util import is_mingw
E   ImportError: cannot import name 'is_mingw' from 'distutils.util' (D:/a/_temp/msys64/mingw64/lib/python3.11/distutils/util.py)
___________ ERROR collecting distutils/tests/test_mingwccompiler.py ___________
ImportError while importing test module 'D:/a/distutils/distutils/distutils/tests/test_mingwccompiler.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
distutils/tests/test_mingwccompiler.py:3: in <module>
    from distutils.util import split_quoted, is_mingw
E   ImportError: cannot import name 'is_mingw' from 'distutils.util' (D:/a/_temp/msys64/mingw64/lib/python3.11/distutils/util.py)
___________ ERROR collecting distutils/tests/test_unixccompiler.py ____________
ImportError while importing test module 'D:/a/distutils/distutils/distutils/tests/test_unixccompiler.py'.
Hint: make sure your test modules/packages have valid Python names.
Traceback:
distutils/tests/test_unixccompiler.py:10: in <module>
    from distutils.util import _clear_cached_macosx_ver
E   ImportError: cannot import name '_clear_cached_macosx_ver' from 'distutils.util' (D:/a/_temp/msys64/mingw64/lib/python3.11/distutils/util.py)

Clearly the wrong 'distutils' is getting imported. I don't know why.

@naveen521kk Can you pull 5fb38a1e1 over to your branch so we can get the CI to update here and then investigate why the wrong distutils is getting imported (but only for the mingw jobs)?

Clearly the wrong 'distutils' is getting imported. I don't know why.

What is the order in sys.meta_path? Anything weird there?

@naveen521kk Can you pull 5fb38a1 over to your branch so we can get the CI to update here and then investigate why the wrong distutils is getting imported (but only for the mingw jobs)?

From what I see you succeeded in pushing it before writing this (??). I can also rebase the whole thing on top of main if wanted.

Clearly the wrong 'distutils' is getting imported. I don't know why.

I can reproduce locally. I'll try to figure out why.

What is the order in sys.meta_path? Anything weird there?

distutils/tests/test_install.py:8: in <module>
    assert 0, sys.meta_path
E   AssertionError: [<_pytest.assertion.rewrite.AssertionRewritingHook object at 0x000001a442ffe510>, <_virtualenv._Finder object at 0x000...mportlib_external.PathFinder'>, <class '__editable___distutils_0_1_dev4112_g5fb38a1_d20240627_finder._EditableFinder'>]

Removing this line makes things work again: https://github.com/pypa/distutils/blob/4fd2d569e37268b8c23f3cc45879465f9c269d92/pytest.ini#L5

@naveen521kk Can you pull 5fb38a1 over to your branch so we can get the CI to update here and then investigate why the wrong distutils is getting imported (but only for the mingw jobs)?

I've pulled those changes. I'll also check out why the wrong distutils are imported.

What is the order in sys.meta_path? Anything weird there?

Not sure if there's anything weird there but this is what I get.
$ python
Python 3.11.9 (main, Apr 12 2024, 09:55:31)  [GCC 13.2.0 64 bit (AMD64)] on win32
Type "help", "copyright", "credits" or "license" for more information.
>>> import sys
>>> sys.meta_path
[<_virtualenv._Finder object at 0x000001745b6ffe50>, <class '_frozen_importlib.BuiltinImporter'>, <class '_frozen_importlib.FrozenImporter'>, <class '_frozen_importlib_external.PathFinder'>, <class '__editable___distutils_0_1_dev4112_g5fb38a1_d20240627_finder._EditableFinder'>]
>>>

I encountered similar errors in collection in #259, which I worked around by pinning pytest. And I can see the pin has taken effect, as pytest 8.0.2 is being used. Yet, somehow the import mode is still finding the wrong distutils. I did a deep dive on the issue in https://github.com/pytest-dev/pytest/issues/12490.  I still have no clue how the msys environment is somehow reviving that issue.

How is that supposed to work anyway? With the pytest setting the current dir isn't in sys.path anymore. The stdlib pathfinder is before the editable finder in sys.meta_path, so I kinda expect it to pick up the wrong distutils, no?
I need to check in a Linux with Python 3.11 somehow, I only have 3.12 without distutils around.

When I was testing with pytest 8.2, where _pytest.pathlib.resolve_pkg_root_and_module_name, invoked when import-mode=importlib, doesn't rely on sys.path at all. On Pytest 8.0.2, the logic is very different. Let me see if I can trace why and how the import works on my macOS machine.

I now tried on Ubuntu 22.04, using Python 3.10, and it fails the same way, importing the wrong distutils.
python3 -m venv venv
source venv/bin/activate
pip install -e '.[test]'
pytest distutils/tests

Aha. I see the difference now. It's the invocation of pytest distutils/tests.
I created this dockerfile to replicate the behavior.
from jaraco/multipy-tox:jammy

RUN git clone https://github.com/msys2-contrib/distutils
WORKDIR distutils
RUN git checkout add-mingw-support
RUN py -3.10 -m venv .venv
RUN py -m pip install -e .[test]
# simulate activating the venv:
ENV PATH=.venv/bin:$PATH
CMD pytest distutils/tests

If I run that docker image, it fails with the same issues in CI.
I think here's what's happening:
When passing distutils/tests to pytest, it causes distutils/* not to be collected, and thus falls back to sys.path for resolving the import distutils. If not passing distutils/tests, pytest will traverse ./distutils and because it's also run with --doctest-modules, the modules in distutils/* get imported during collection.
Indeed, if I disable the line with --doctest-modules and then run tests with pytest, the same collection failure occurs. The same problem exists even after restoring pytest 8.2+.
It seems that the reason I haven't encountered this issue previously or with other skeleton-based projects is because I rarely ever direct the collection by providing a subpath, but instead I use -k <pattern> to downselect tests after collection (so doctests are always collected even if not run).

What about [adding some config]?

I really try to avoid having to add config, especially to a single project. I'd like to be able to rely on defaults and best practices to make the project under test importable. I guess distutils is special here, because although it's pip-installed, a pip-installed package doesn't take precedence over a stdlib module.
How about for now, let's update the test execution to run the same way as it runs for other jobs (without specifying distutils/tests)?

How about for now, let's update the test execution to run the same way as it runs for other jobs (without specifying distutils/tests)?

Done, see the commits for details.
It seems a bit brittle since this import side effect no longer seems to be there with pytest 8.2.0 for example, but fine with me. If you update pytest in the future I'd be happy to help debug Windows specific issues.
For future reference, this makes the tests pass with pytest 8.2.0 here:
diff --git a/pytest.ini b/pytest.ini
index b53e0d93..14188d07 100644
--- a/pytest.ini
+++ b/pytest.ini
@@ -3,7 +3,7 @@ norecursedirs=dist build .tox .eggs
 addopts=
 	--doctest-modules
 	--import-mode importlib
-consider_namespace_packages=true
+pythonpath= .
 filterwarnings=
 	## upstream

Looks great. Thanks!

Thanks!
If there is any problems/issues feel free to ping us


WIP: Relaunch of the official website.

The angular-maps.com gets a new look and a new technical base and home.
The template and the docs files now live in this repo.

Done 🎉  New website is online!


Implement AindBehaviorTaskLogicModel

Waiting for #799
https://allenneuraldynamics.github.io/Aind.Behavior.Services/api.base/task_logic.html#
This will create effective documentation of parameters: (closing redundant issue: https://github.com/AllenNeuralDynamics/dynamic-foraging-task/issues/418)
This will clean up the save/load process (closing redundant issue: https://github.com/AllenNeuralDynamics/dynamic-foraging-task/issues/280)
This will facilitate implementation of https://github.com/AllenNeuralDynamics/aind-behavior-curriculum
This will facilitate managing sessions/mice through SLIMS
Add to NWB file (not entirely clear where)

talk Han about autotrain data model


Image not uploading properly on Automatic Deployment to Github

It seems like images are not able to properly upload on Github currently when we are deploying FOSSASIA Summit on Github. This problem didn't exist before. Currently working on a fix.

@Princu7 I was gonna open the issue, please also change the text "Press the button below to start" when the deploy is initiated to "Press the button below to abort".

@Princu7 The problem occurs randomly, may be it is due to timeout. I tried the feature 3 times and did not get any error. I think increasing the time interval for requests will fix the issue.
What is your opinion on this?

@geekyd Thanks for the confirmation. I was also testing it out on Heroku and found no error. Actually, the time interval between requests is quite elastic(1 second) and shouldn't cause any problem. Sometimes, the Heroku servers are down which means they can't properly download or upload file. In this case, when the uploading and committing of a file takes time on Github, it throws a Socket Hang Up error. I guess this is what was happening on Heroku at that time. The servers were not functioning properly and hence there were so many errors while uploading the image file.
I tested on my unstable internet connection and got a few errors of this type. You can see it in the screenshot below:

@Princu7 That's awesome the issue is solved automatically 😄 . There is one problem that still exist in the deploy functionality, the progress bar stops when an error occurs but the log says the app is successfully deployed. Can you look in to it?

@geekyd Thanks for reminding for changing the text  Prese below button to start to Press below button to abort when the build is initiated. I will send a pull request regarding this soon. And could you please clarify more regarding the error point. Do you mean the errors apart from the event files upload and commit? Like failure while creating of the repository in the user's github account?

@Princu7 It seems the errors apart from upload errors halt the progress bar, it should get reset if such case occurs. While using deploy, the progress bar halted at 89% but the logs were updating. It logged a success message but it failed.

@geekyd Thanks for the details. I would surely look into it :)

@geekyd I am having a little trouble reproducing the error. Could you please mention any one specific instance when the problem related to the halting of the progress bar occurs? Would be great if we could properly catch the bug and remove it. Thanks!!

@Princu7 I tried to reproduce the error and found that the deploy sometimes halts without any notification please check the screen shot.

This issue was partially solved. Hence re-opening this :)

@geekyd If the deploy halts sometimes during the upload of a file, I think it might be happening because of some Heroku server problem. It might be the case that the Heroku server might be not working properly and hence the file is not getting uploaded and committed. In that case, timeout should occur after some time and a failed message should be displayed. How long did it got stuck at that point?
It's really difficult to fully get the issue which is causing the error :smile:. What do you suggest?


Removing Where Clauses from For-In Loops

This proposal removes where clauses from for-in loops, where they are better expressed (and read) as guard conditions.
Swift Evolution Discussion: [Pitch] Retiring where from for-in loops

Thanks, I'll kick this off.


Square of a number

Why:
Closes https://github.com/codinasion/codinasion/issues/89
What's being changed:

Added a Python program that outputs the square of a given number

Check off the following:

[x] I have reviewed my changes in staging (look for "Automatically generated comment" and click Modified to view your latest changes).
[x] For content changes, I have completed the self-review checklist.

Hii @harshi1122
Thanks for your continuous contributions 👍🏻

Hii @harshi1122
Thanks for your continuous contributions 👍🏻

I am looking to contribute more here on Codinasion!
I like this organization :)

Hey @harshraj8843
I have made necessary changes and pushed them to the branch here but I don't know why the changes aren't visible here.
They are somehow visible in the recent branch of XpowerY which I made
Is that a problem?
If something doesn't work, please guide me.

Hey
I will work on it soon
I messed up the branches and will make changes tomorrow
Thanks
On Sat, 19 Feb 2022 at 19:38 Harsh Raj @.***> wrote:

@.**** requested changes on this pull request.
Please add a README.md for python/programme/6-square-of-number/
—
Reply to this email directly, view it on GitHub
https://github.com/codinasion/codinasion/pull/155#pullrequestreview-887946283,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AU2A2S6MKA2FPFACDNNFBBLU37BPJANCNFSM5O2VED2A
.
Triage notifications on the go with GitHub Mobile for iOS
https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675
or Android
https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
You are receiving this because you were mentioned.Message ID:
@.***>

Preview : https://codinasion--pr10-dev-65w226w0.web.app/python/programme/6-square-of-number/
(expires Sun, 27 Feb 2022 02:52:38 GMT)

LIVE : https://codinasion.web.app/python/programme/6-square-of-number/


Add file and line arguments to encoder/decoder test callbacks for better debug info

Added some extra macros locally to make it easier to call the test_* macros which stringize some arguments.
Fixes #14331

[x] tests are added or updated

24 hours has passed since 'approval: done' was set, but this PR has failing CI tests.  Once the tests pass it will get moved to 'approval: ready to merge' automatically, alternatively please review and set the label manually.

I've slightly edited the commit message to split subject and body of it and merged it to master. Thank you for your contribution.


Switching Cameras While Recording

I am looking for help implementing Switching cameras between front and rear camera. This will require a rewrite to use AVCaptureVideoDataOutput and knowledge of AVAssetReader and AVAssetWriter. Any help would be appreciated!

Bump ^^


live apply stuck

Expected behavior
live apply proceeds after explicit depends-on target is reconciled
Actual behavior
live apply stalls after explicit depends-on target is reconciled
Information
Scenario 1
PubSubTopic resource has a dependency on Project via a depends-on annotation. LoggingLogSink is dependent on PubSubTopic resource via pubSubTopicRef in KCC but has no depends-on annotation.
When we do a kpt live apply this is the output
installing inventory ResourceGroup CRD.
inventory update started
inventory update finished
apply phase started
configmap/setters apply skipped: inventory policy prevented actuation (strategy: Apply, status: NoMatch, policy: MustMatch)
logginglogsink.logging.cnrm.cloud.google.com/PROJECT_ID-pubsubsink apply successful
project.resourcemanager.cnrm.cloud.google.com/PROJECT_ID apply successful
apply phase finished
reconcile phase started
configmap/setters reconcile skipped
logginglogsink.logging.cnrm.cloud.google.com/PROJECT_ID-pubsubsink reconcile pending
project.resourcemanager.cnrm.cloud.google.com/PROJECT_ID reconcile successful
project.resourcemanager.cnrm.cloud.google.com/PROJECT_ID reconcile pending
project.resourcemanager.cnrm.cloud.google.com/PROJECT_ID reconcile successful

It seems to be stuck after project is reconciled. Running live status in another window.
kpt live status --poll-until=forever
pubsubtopic.pubsub.cnrm.cloud.google.com/PROJECT_ID-ps-dataset is NotFound: Resource not found
project.resourcemanager.cnrm.cloud.google.com/PROJECT_ID is InProgress: Update in progress
logginglogsink.logging.cnrm.cloud.google.com/PROJECT_ID-pubsubsink is InProgress: reference PubSubTopic config-control/PROJECT_ID-ps-dataset is not found
project.resourcemanager.cnrm.cloud.google.com/PROJECT_ID is Current: Resource is Current

If I exit and reapply it still seems to be stuck.
installing inventory ResourceGroup CRD.
inventory update started
inventory update finished
apply phase started
logginglogsink.logging.cnrm.cloud.google.com/PROJECT_ID-pubsubsink apply successful
project.resourcemanager.cnrm.cloud.google.com/PROJECT_ID apply successful
apply phase finished
reconcile phase started
logginglogsink.logging.cnrm.cloud.google.com/PROJECT_ID-pubsubsink reconcile pending
project.resourcemanager.cnrm.cloud.google.com/PROJECT_ID reconcile successful

My suspicion is it is waiting for logginglogsink to reconcile since it applied it in the initial apply phase. However as logginglogsink has pubSubTopicRef to the pubsub resource it is unable to make progress. If this is the case, I believe kpt should just be looking at just explicit deps when trying to decide next apply phase.
Scenario 2
If I add an explicit depends-on to LoggingLogSink resource to wait for PubSubTopic resource and start fresh apply, it seems to complete immediately without waiting for resources to reconcile although it reports it had reconciled. Note - this was another brand new project not a continuation of scenario 1.
installing inventory ResourceGroup CRD.
inventory update started
inventory update finished
apply phase started
project.resourcemanager.cnrm.cloud.google.com/PROJECT_ID apply successful
apply phase finished
reconcile phase started
project.resourcemanager.cnrm.cloud.google.com/PROJECT_ID reconcile successful
reconcile phase finished
apply phase started
pubsubtopic.pubsub.cnrm.cloud.google.com/PROJECT_ID-ps-dataset apply successful
apply phase finished
reconcile phase started
pubsubtopic.pubsub.cnrm.cloud.google.com/PROJECT_ID-ps-dataset reconcile successful
reconcile phase finished
apply phase started
logginglogsink.logging.cnrm.cloud.google.com/PROJECT_ID-pubsubsink apply successful
apply phase finished
reconcile phase started
logginglogsink.logging.cnrm.cloud.google.com/PROJECT_ID-pubsubsink reconcile successful
reconcile phase finished
inventory update started
inventory update finished
apply result: 3 attempted, 3 successful, 0 skipped, 0 failed
reconcile result: 3 attempted, 3 successful, 0 skipped, 0 failed, 0 timed out

Running a live status right after this shows project is still reconciling and other are erroring as project is not created yet.
pubsubtopic.pubsub.cnrm.cloud.google.com/PROJECT_ID-ps-dataset is Failed: Update call failed: error applying desired state: summary: Error creating Topic: googleapi: Error 404: Requested project not found or user does not have access to it (project=PROJECT_ID). Make sure to specify the unique project identifier and not the Google Cloud Console display name.
project.resourcemanager.cnrm.cloud.google.com/PROJECT_ID is InProgress: Update in progress
logginglogsink.logging.cnrm.cloud.google.com/PROJECT_ID-pubsubsink is InProgress: reference PubSubTopic config-control/PROJECT_ID-ps-dataset is not ready
project.resourcemanager.cnrm.cloud.google.com/PROJECT_ID is Current: Resource is Current
pubsubtopic.pubsub.cnrm.cloud.google.com/PROJECT_ID-ps-dataset is InProgress: Update in progress
pubsubtopic.pubsub.cnrm.cloud.google.com/PROJECT_ID-ps-dataset is Current: Resource is Current
logginglogsink.logging.cnrm.cloud.google.com/PROJECT_ID-pubsubsink is Current: Resource is Current

Eventually everything reconciles while behaving as if everything were applied at once without depends-on.

Kpt Version: 1.0.0-beta.17
Kpt Package that can demonstrate the error:  https://github.com/bharathkkb/kpt-live-depends-issue

/cc @karlkfi if you have any ideas or my yaml is misconfigured

The behavior Scenario 1 seems expected. Without the depends-on, kpt doesn't know the LoggingLogSink depends on the PubSubTopic, and the LoggingLogSink won't become reconciled until after the PubSubTopic is applied and reconciled. So kpt applies the Project and LoggingLogSink and waits forever for the LoggingLogSink to reconcile, which it won't, because it hasn't been applied.
You can make it time out with the --reconcile-timeout flag, but by default it waits forever.
The behavior of Scenario 1 seems to imply that Project, PubSubTopic, and LoggingLogSink only wait for their dependencies to exist in KRM and not GCP before being recognized as reconciled. But I'll need to try it to know for sure. Or you can paste the object YAML with their full status at the end of the kpt live apply using something like kubectl get -f ./ -o yaml.
I'm guessing that kstatus is recognizing KCC dependency errors as not-reconciled, but isn't recognizing whatever the in-progress condition is as not-reconciled. There's a number of "standard" ways kstatus recognizes reconciliation, and KCC may not have implemented them consistently. At least, that's my guess for now. It could also be a bug, but I'd like to rule out occam's razor first.

Thank for looking into this @karlkfi!

The behavior Scenario 1 seems expected. Without the depends-on, kpt doesn't know the LoggingLogSink depends on the PubSubTopic, and the LoggingLogSink won't become reconciled until after the PubSubTopic is applied and reconciled. So kpt applies the Project and LoggingLogSink and waits forever for the LoggingLogSink to reconcile, which it won't, because it hasn't been applied.

Wouldn't it be better to proceed to applying PubSubTopic  as soon as Project is resolved as LoggingLogSink is not a dependency?

The behavior of Scenario 2 seems to imply that Project, PubSubTopic, and LoggingLogSink only wait for their dependencies to exist in KRM

Right, and whats odd is live status does seem to pick up the UpdateFailed status. I will try to grab some logs tomorrow.

FWIW, if you remove all the depends-on, it should work fine too. It would be similar to Scenario 2, except all in one apply & reconcile phase.

Yeah this is what we currently have but hoping to leverage depends on to reduce some of the log verbosity for automation when we have alot of resources.

Wouldn't it be better to proceed to applying PubSubTopic as soon as Project is resolved as LoggingLogSink is not a dependency?

Yes. It’s been on my TODO list to rewrite the task scheduler to use an asynchronous dependency graph, but for now the implication is a graph flattened into phases. So if a reconcile phase doesn’t succeed, it doesn’t continue.
If you put a reconcile timeout on it, it might actually succeed, but the task scheduler doesn’t know that.


Fix system tests

Pull Request Test Coverage Report for Build 406

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage increased (+2.7%) to 80.783%

Totals

Change from base Build 402:
2.7%

Covered Lines:
1774

Relevant Lines:
2196

💛  - Coveralls


[UI] Update Git Resources Section

Description
This pull request introduces a carousel to the Git & GitHub resources section using the Swiper library. The following changes were made to enhance the user experience and provide a clean, interactive way to navigate through the resources.
Changes Made:

Carousel Implementation: Integrated the Swiper library to create a responsive carousel for the resources section.

Color Theme: Followed a consistent color theme for the carousel items to match the overall UI design of the page.

Arrow Buttons and Pagination: Added neat and intuitive arrow buttons for navigation and implemented pagination for easy access to specific items within the carousel.

Hover Effects and Animations: Enhanced user interaction by adding hover effects on carousel items and also included smooth animations to improve the overall visual appeal.

Before :

After :

Category

[ ] Resource Addition
[ ] Documentation
[ ] Codebase
[x] User Interface
[ ] Feature Addition

Related Issue
Fixes #548
Checklist

[x] I have followed the CONTRIBUTING guide
[x] I have tested changes on my local computer (if applicable)

Good work, @tharagaramanbalaji.
As per my preference:

Can you include 3 rows in each slide with each row containing 3 resources?
Can you change the slider design to match the one in the 'Introduction to Open Source' Page?

Here is a design for your reference while executing the first suggestion:

Alright @Sriparno08 will make the necessary changes as you mentioned 🙌🙌

@Sriparno08 any other to make let me know...commited with required changes

Thank you for making the necessary changes and merging the pr @Sriparno08


fix: bug when iterating a pipeline with deleted items

related to this issue https://github.com/wolfi-dev/os/actions/runs/7726478907/job/21062833724#step:5:30259

Fixed the test! It was missing a \n in one file.


add option for automatic JMX retry

minor code changes
add simple retry strategy

What does this PR do?
Some MBeans throw exceptions when the state they expose isn't completely initialized yet.
When the agent starts, such MBeans will be ignored by the agent as they can't be accessed and the agent requires to get their values on registration to get their type, in particular for composite attributes, this is not something that can't be known before invocation.
Checklist

[x] This is an enhancement of existing features, or a new feature in existing plugins

[x] I have updated CHANGELOG.asciidoc
[x] I have added tests that prove my fix is effective or that my feature works
[ ] Added an API method or config option? Document in which version this will be introduced
[ ] I have made corresponding changes to the documentation

run docs-build


Governance leadership sample error (2.10)

When testing release 2.10, it's noted the governance leadership sample fails with:
eclient ./governance-leadership-sample-2.10-jar-with-dependencies.jar cocoMDS2 https://localhost:9443 garygeeke
Picked up JAVA_TOOL_OPTIONS: --add-exports=java.naming/com.sun.jndi.ldap=ALL-UNNAMED
===============================
Governance Leadership Sample
===============================
Running against server: cocoMDS2 at https://localhost:9443
Using userId: garygeeke
Creating profiles for Jules and Ivor
Exception: org.odpi.openmetadata.frameworks.connectors.ffdc.PropertyServerException with message OMAG-GENERIC-HANDLERS-500-002 The Community Profile OMAS service has not implemented the getNewBean(entity) method in a subclass of the org.odpi.openmetadata.accessservices.communityprofile.converters.PersonalProfileConverter converter class for bean class org.odpi.openmetadata.accessservices.communityprofile.metadataelement.PersonalProfileUniverse and so is unable to create the bean for method getPersonalProfileByGUID

I believe this is fixed in master

Retesting this with 3.0-SNAPSHOT and the original error is fixed. However I do see another little glitch:
eclient ./governance-leadership-sample-3.0-SNAPSHOT-jar-with-dependencies.jar cocoMDS2 https://localhost:9443 garygeeke

Picked up JAVA_TOOL_OPTIONS: --add-exports=java.naming/com.sun.jndi.ldap=ALL-UNNAMED
===============================
Governance Leadership Sample
===============================
Running against server: cocoMDS2 at https://localhost:9443
Using userId: garygeeke
Creating profiles for Jules and Ivor
----------------------------
Profile: f88bdaa5-eb05-4164-b2fc-7bffcdc5a7ac
  UserId: julesKeeper
  Employee Id: 026
  Full Name: Julian Keeper
  Known Name: Jules Keeper
  Job Title: Chief Data and Privacy Role
  Job Description: Chief Data and Privacy Role
  Work Location: 2
  Contact Type: Employee
----------------------------
----------------------------
Profile: d52535f8-a299-4350-8c7d-d43aa2a6c971
  UserId: ivorPadlock
  Employee Id: 008
  Full Name: null
  Known Name: Ivor Padlock
  Job Title: Security Executive
  Job Description: Security Executive
  Work Location: 1
  Contact Type: Employee
----------------------------
Creating CDO, CPO and CSO governance officers
----------------------------
Governance Role: 62233676-a7cf-4fd3-9da4-e96e02bb5ee8
  Domain: 1
  Appointment Id: EXEC-CDO
  Appointment Scope: null
  Title: Chief Data Role (CDO)
  -- Current Appointees-----
  Appointee: <None>
----------------------------
  -- Predecessors ----------
  Appointee: <None>
----------------------------
  -- Planned Successors-----
  Appointee: <None>
----------------------------
----------------------------
----------------------------
Governance Role: c3f581f6-c094-4caf-a9a0-ac39a7951704
  Domain: 2
  Appointment Id: EXEC-CPO
  Appointment Scope: null
  Title: Chief Privacy Role (CPO)
  -- Current Appointees-----
  Appointee: <None>
----------------------------
  -- Predecessors ----------
  Appointee: <None>
----------------------------
  -- Planned Successors-----
  Appointee: <None>
----------------------------
----------------------------
----------------------------
Governance Role: da2565d8-03ae-40a9-8d91-330f1bb93199
  Domain: 3
  Appointment Id: EXEC-CSO
  Appointment Scope: null
  Title: Chief Security Role (CSO)
  -- Current Appointees-----
  Appointee: <None>
----------------------------
  -- Predecessors ----------
  Appointee: <None>
----------------------------
  -- Planned Successors-----
  Appointee: <None>
----------------------------
----------------------------
Exception: org.odpi.openmetadata.frameworks.connectors.ffdc.InvalidParameterException with message OMAG-COMMON-400-010 The number of records to return, 500, passed on the 100 parameter of the getGovernanceRolesByDomainId operation, is greater than the allowable maximum of 100

This occurs specifically when running against a coco environment (notebooks)

The error message seems wrong in that it refers to 'passed on the 100 parameter'. I presume it means 'passed on the pagesize parameter' or similar
If more records are requested than the max page size, I wonder if it would be reasonable to just return the maximum allowed (ie 100)? (though current behaviour is understandable)
We may want to change the default page size in the coco notebooks - or use a default value in the same

In PR #5513 I have change the configuration of the servers to use a max page size of 600 - this still allows the page size option to be validated whilst setting it to a bigger number than the client default max page size.

So I think that addresses, in a way, the third point - but I wonder if we should do anything more generally on point 2? And also fix the error message for point 1?

I thought I had fixed the error message - is it still a problem?
It is not helpful to return  the lower number of results than the max page size since it may be interpreted as the method just returning all that here is rather than all the elements allowed by max page size.

I've not retested since about a week ago.
I tried just now on the 3.0 release and ended up with:
Exception: org.odpi.openmetadata.frameworks.connectors.ffdc.PropertyServerException with message OMAG-REPOSITORY-HANDLER-500-001 An unexpected error org.odpi.openmetadata.repositoryservices.ffdc.exception.RelationshipNotKnownException was returned to removeRelationship by the metadata server during deleteGovernanceRole request for open metadata access service Governance Program OMAS on server cocoMDS2; message was OMRS-REPOSITORY-404-012 The PersonRoleAppointment relationship identified with guid 7553a3c2-4d7a-4f2c-a528-64a0f4f0c7a0 passed on the getRelationship call is soft-deleted in the open metadata repository cocoMDS2

This is running locally, with 'data' directory deleted before start, then the coco server config/start notebooks run
I can look in more detail tomorrow/check master

The same error occurs in master (as of 3 Aug). I posted the full log to https://gist.github.com/3cc8b7634c91e0dbb00e04f7b7dd780b
This is just the cleanup at the end of the test and may just be slightly inopportune reporting of the condition


__vueEditorBridge appears on suggestion list

Platform: Win
Vetur version: 0.8.5
VSCode version: 1.13.1

Problem

Reproducible Case
Trigger intellisence (Ctrl + Space) in script tag inside vue file

I don't have a WIndows machine at hand, but probably some Windows path handling problem.

This is introduced by option contextual typing. We can simply filter it out.


Surface curated list associated with schema version in python API

Surface:
System Curated List
Organ Curated List
Cell Class Curated List
Cell Subclass Curated List
Tissue General Curated List
Development Stage Curated List

PR: https://github.com/chanzuckerberg/cellxgene-ontology-guide/pull/141


Wait for wallet to load

Addresses #4091.
@gmart7t2 This catches a couple of errors that usually occur when the wallet takes a long time to load. It should now wait until a wallet or descriptor is finished loading before proceeding.
Do you know by chance what the Bitcoin Core error code or message is if a descriptor for a wallet is still loading?

Do you know by chance what the Bitcoin Core error code or message is if a descriptor for a wallet is still loading?

I think it's:
error code: -18 error message: Requested wallet does not exist or is not loaded


Monitoring UI: Black lines mouseover area is too large

Version: Master 2.2 (3/18/19)
What kind of request is this (question/bug/enhancement/feature request):
Bug
Steps to reproduce (least amount of steps as possible):

Enable monitoring
Hover about 20px away from the black outlines and you will still get a tooltip.

Hover near the Used area and you can still get a tooltip for reserved because the mouseover area is too large and seems to overlap.

Result:
You can get incorrect mouseover data because the area for hovering is too large and may even overlap.

Version: Master 2.2 (3/19/19) ImageID: 022651b0ec13
Confirmed issue. The mouseover area is much smaller now and I can no longer accidentally hover over the wrong area and get results for another wheel, etc. I think the new area is still reasonable as well. You have to pretty much be on top of the appropriate area and this is still easy to do.