Please improve the Azure Cosmos DB Emulator MongoDB API Guidance

I'm finding it really hard to understand how to use the emulator with the MongoDB API. The documentation is quite limited and I have not been able to make much progress.
MongoDB wire protocol version 3.2
Enabling the 3.2 MongoDB protocol is documented OK and I'm able to get this working. However, I need the 3.6 version for some extra features that are supported.
MongoDB wire protocol version 3.6
Following the documentation, I was able to start the emulator with:
C:\Program Files\Azure Cosmos DB Emulator> Microsoft.Azure.Cosmos.Emulator.exe /EnableMongoDbEndpoint=3.6

However, port 10250 isn't being used (as per the documentation).
I found this comment (from 2017), which suggests that the MongoDB API is on port 10250. I tried using that without much luck.
I also tried using:
C:\Program Files\Azure Cosmos DB Emulator>Microsoft.Azure.Cosmos.Emulator.exe /EnableMongoDbEndpoint=3.6 /MongoPort=10255

With this, I am able to connect but get the following error when trying to create new documents.
Error=2,
Details='Microsoft.Azure.Documents.BadRequestException:
Message: {"Errors":["PartitionKey extracted from document doesn't match the one specified in the header"]}ActivityId: 02493bde-9f24-4a62-a515-fa0fd27f27a2,
Request URI: /apps/DocDbApp/services/DocDbServer6/partitions/a4cb4952-38c8-11e6-8106-8cdcd42c33be/replicas/1p/,
RequestStats:
RequestStartTime: 2020-02-12T20:47:27.8471941Z,
RequestEndTime: 2020-02-12T20:47:27.8488575Z,
Number of regions attempted:1
ResponseTime: 2020-02-12T20:47:27.8488575Z,
StoreResult:
StorePhysicalAddress: rntbd://<IP_ADDRESS>:10253/apps/DocDbApp/services/DocDbServer6/partitions/a4cb4952-38c8-11e6-8106-8cdcd42c33be/replicas/1p/,
LSN: 13,
GlobalCommittedLsn: -1,
PartitionKeyRangeId: 0,
IsValid: True,
StatusCode: 400,
SubStatusCode: 1001,
RequestCharge: 1.24,
ItemLSN: -1,
SessionToken: -1#13,
UsingLocalLSN: False,
TransportException: null,
ResourceType: Document,
OperationType: Create, SDK:
Windows/10.0.18362 cosmos-netstandard-sdk/3.3.2

at Microsoft.Azure.Documents.StoreResult.ToResponse(RequestChargeTracker requestChargeTracker)
at Microsoft.Azure.Documents.ConsistencyWriter.WritePrivateAsync(DocumentServiceRequest request, TimeoutHelper timeout, Boolean forceRefresh)
at Microsoft.Azure.Documents.BackoffRetryUtility`1.ExecuteRetryAsync(Func`1 callbackMethod, Func`3 callShouldRetry, Func`1 inBackoffAlternateCallbackMethod, TimeSpan minBackoffForInBackoffCallback, CancellationToken cancellationToken, Action`1 preRetryCallback)   at Microsoft.Azure.Documents.ShouldRetryResult.ThrowIfDoneTrying(ExceptionDispatchInfo capturedException)
at Microsoft.Azure.Documents.BackoffRetryUtility`1.ExecuteRetryAsync(Func`1 callbackMethod, Func`3 callShouldRetry, Func`1 inBackoffAlternateCallbackMethod, TimeSpan minBackoffForInBackoffCallback, CancellationToken cancellationToken, Action`1 preRetryCallback)   at Microsoft.Azure.Documents.ConsistencyWriter.WriteAsync(DocumentServiceRequest entity, TimeoutHelper timeout, Boolean forceRefresh, CancellationToken cancellationToken)
at Microsoft.Azure.Documents.ReplicatedResourceClient.<>c__DisplayClass26_0.<<InvokeAsync>b__0>d.MoveNext()--- End of stack trace from previous location where exception was thrown ---
at Microsoft.Azure.Documents.RequestRetryUtility.ProcessRequestAsync[TRequest,IRetriableResponse](Func`1 executeAsync, Func`1 prepareRequest, IRequestRetryPolicy`2 policy, CancellationToken cancellationToken, Func`1 inBackoffAlternateCallbackMethod, Nullable`1 minBackoffForInBackoffCallback)
at Microsoft.Azure.Documents.ShouldRetryResult.ThrowIfDoneTrying(ExceptionDispatchInfo capturedException)
at Microsoft.Azure.Documents.RequestRetryUtility.ProcessRequestAsync[TRequest,IRetriableResponse](Func`1 executeAsync, Func`1 prepareRequest, IRequestRetryPolicy`2 policy, CancellationToken cancellationToken, Func`1 inBackoffAlternateCallbackMethod, Nullable`1 minBackoffForInBackoffCallback)
at Microsoft.Azure.Documents.StoreClient.ProcessMessageAsync(DocumentServiceRequest request, CancellationToken cancellationToken, IRetryPolicy retryPolicy, Func`2 prepareRequestAsyncDelegate)   at Microsoft.Azure.Documents.ServerStoreModel.ProcessMessageAsync(DocumentServiceRequest request, CancellationToken cancellationToken)
at Microsoft.Azure.Cosmos.Handlers.TransportHandler.SendAsync(RequestMessage request, CancellationToken cancellationToken)

However, I don't get this problem when trying the exact same set of commands with an actual Cosmos DB, which works fine. I am unsure where to go from here.
Docker
The documentation on docker hub does not reference the MongoDB API at all. I figured out that you can enable the MongoDB Endpoint by setting the -e AZURE_COSMOS_EMULATOR_MONGODB_ENDPOINT=true. But I cannot figure out how to use protocol version 3.6.
For now, I will develop locally using a mongo server and hope that everything works when it comes to production. However, I would prefer to keep my develop and production environments as similar as possible, so any help would be much appreciated.

Document details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 109ed3f8-faf1-92b9-bf50-4be52e9099d4
Version Independent ID: ebc5326a-46da-6bc1-1f47-01a8e16d11fb
Content: Develop locally with the Azure Cosmos Emulator
Content Source: articles/cosmos-db/local-emulator.md
Service: cosmos-db
GitHub Login: @markjbrown
Microsoft Alias: mjbrown

@samgladstone We are checking this and we will get back to you.

Hi @samgladstone
For this issue for creating a docker emulator for MongoDB 3.6 please open the Data Explorer in the emulator and submit this feedback there. The team that does this work tracks their work items from the feedback link in the Data Explorer there.
Thanks.
#please-close

Please add the below to the documentation when using docker image. This wasn't obvious to me as all the port mappings seem to imply that all apis are by default enabled. Also, enabling MongoDB API is undocumented - even in https://hub.docker.com/r/microsoft/azure-cosmosdb-emulator/
When creating docker image, to enable support for other API endpoints, you need to include these parameters (not sure if you can enable multiple)
a) For Gremlin:
-e AZURE_COSMOS_EMULATOR_GREMLIN_ENDPOINT=true
b) For Cassandra
-e AZURE_COSMOS_EMULATOR_CASSANDRA_ENDPOINT=true
c) For MongoDB
-e AZURE_COSMOS_EMULATOR_MONGODB_ENDPOINT=true

In case anyone else comes across this issue and to add to the above, the MongoDB 3.6 Endpoint can be enabled with this param:
-e AZURE_COSMOS_EMULATOR_MONGODB_COMPUTE_ENDPOINT=true
A couple of extra things to note on it;

The person I spoke to when submitting my feedback said:

Previously when MongoDB 3.6 was enabled, it will use the 10250 as the default port; this can be particularly confusing since the connection strings points to port 10255. In the latest version of the emulator (2.9.2) we made this setting consistent and the default port is now 10255.

You can't enable both the 3.2 & 3.6 endpoints at the same time (I'm not sure about other endpoints)

When enabling the 3.6 protocol, you can't use the UI to carry out tasks such as creating containers etc, this needs to be done via commands.

Sadly it seems that using AZURE_COSMOS_EMULATOR_MONGODB_COMPUTE_ENDPOINT no longer works to get the 3.6 endpoint. By now we have the 4.0 endpoint, so getting that to work would be great. Any ideas?


WIP: Configuration needed for using unified website

[x] add basePath for the website
[x] figure out development of the website (basePath should be /)
[x] use guild-components with fixes for image path
[ ] use guild-components with fixes for header
[x] Experiment with CF Pages (@dotansimha )

@B2o5T the CloudFlare Pages build fails, here's the log from the build job:

02:57:58.186 | info  - SWC minify release candidate enabled. https://nextjs.link/swcmin
-- | --
02:57:58.383 | info  - using build directory: /opt/buildhome/repo/website/.next
02:57:58.385 | warn  - rewrites, redirects, and headers are not applied when exporting your application, detected (redirects). See more info here: https://nextjs.org/docs/messages/export-no-custom-routes
02:57:58.411 | info  - Copying "static build" directory
02:57:58.537 | info  - No "exportPathMap" found in "/opt/buildhome/repo/website/next.config.mjs". Generating map from "./pages"
02:57:58.537 | Error: Image Optimization using Next.js' default loader is not compatible with `next export`.
02:57:58.537 | Possible solutions:
02:57:58.537 | - Use `next start` to run a server, which includes the Image Optimization API.
02:57:58.538 | - Configure `images.unoptimized = true` in `next.config.js` to disable the Image Optimization API.
02:57:58.538 | Read more: https://nextjs.org/docs/messages/export-image-api
02:57:58.538 | at /opt/buildhome/repo/website/node_modules/next/dist/export/index.js:150:23
02:57:58.538 | at async Span.traceAsyncFn (/opt/buildhome/repo/website/node_modules/next/dist/trace/trace.js:79:20)
02:57:58.559 | error Command failed with exit code 1.
02:57:58.559 | info Visit https://yarnpkg.com/en/docs/cli/run for documentation about this command.
02:57:58.583 | Failed: build command exited with code: 1

I think the recent changes does not fully support next export?


M3-291 linode configs

Purpose

List, create, edit, and delete Linode configs from the LinodeSettings section.

Non-field-related errors (which I usually call generalError) are not shown to the user, and the form appears stuck.
Use hasErrorFor('none')


Add penny sterling

Add penny sterling currency (GBX).
Used on the London stock exchange.

It looks like the currency is not official iso 4217 currency. If you want to add it to your project you can call AddCurrency()
(international standards) Unofficial non-ISO 4217 currency code for the British penny sterling.

Thank you, noted.


Is there any portable way to know if the socket has timed out on client side vs on server side?

Beast version 1.71
Hi,
Is there any portable way to know if the socket has timed out on client side vs on server side?
As far as i have tested, on linux, i get error code 1 for both client side timeout and server side socket close [not able to emulate serverside socket timeout so instead closed the socket]
On windows, i get error code 1 for client side timeout and 10053 for server side socket close.
So how do i definitely know on linux if its a client vs server socket timeout?

Who is claiming the timeout?
A client timeout is when the client abandons an async operation due exceeding a time limit.
A server timeout is when the server does the same.
Each party always knows when they are cancelling an operation. If the "other end" closes the connection, there will not be a timeout, instead it will look like the connection is closed (connection reset, short read or eof).
In short, I think you need to show some code to demonstrate how you're getting the values you describe.

at client side timeout is set as:
m_stream.expires_after(std::chrono::seconds(secs));
at server end, it may have its own policy when to timeout sockets, so as to save resources. In our usage its after 300secs of idle socket.(we dont have control on server's policy , it can be anything)
In both the cases i get the above error_codes as mentioned on linux and windows plats.
On linux in both cases i get 1 as error code.
So how can i differentiate between the two on linux?

On linux in both cases i get 1 as error code.

That doesn't really make sense to me. Again, I think instead of describing things, we need a minimal example that shows what you're doing. (E.g. you just accidentally told use that you're using one of Beast's stream models, because you added that you're using m_stream.expires_after, but we still don't know what model. Actually, we don't even know that you're using async operations, or how the service is run)

@ashjas has your question been answered?

@klemens-morgenstern yes


Springroll 2.0 and Browserify

Hi,
I am using Browserify and Springroll 2.0. I was not able to import springroll through:
import * as springroll from 'springroll';

I had to do:
import * as springroll from 'springroll/dist/SpringRoll-umd';

It seems to be because there is no main variable in Springroll's package.json, as per this issue on  Browserify's github (https://github.com/browserify/browserify/issues/1541)
Cheers.

Hi @laurieattwobulls!
Andrew's got a PR up #210 that should resolve that issue. I'll get that merged now. Let me know if you still encounter issues


Shift in plotted mesh in flywire

The meshes plotted by gal4line2flywire script sometimes have shifts anteriorly.

All the code comes from the gal4line2flywire example, except: ALad1 (VFB_00020032) may be a good example as you can see that some of the plotted mesh is outside the brain mesh. Here's a flywire link with the brain mesh. You could use this as the shorturl.
However this shift doesn't always happen, and I'm not sure what triggers it. Please let me know if you'd like me to paste all the code I ran here.

This DM5 mesh has been shifting for me, having tried many times. Here's all the code I ran:
import navis
import fafbseg
import flybrains

import os
import numpy as np
import pandas as pd
import copy

from pyroglancer.localserver import startdataserver, closedataserver
from pyroglancer.flywire import flywireurl2dict, add_flywirelayer
from pyroglancer.utils import pointcloud2meshes

import trimesh as tm
import open3d as o3d

from vfb_connect.cross_server_tools import VfbConnect
vc = VfbConnect()
vfb_id = 'VFB_00020020'
# 'VFB_00020048': DM6
# 'VFB_00020085': DM4
# VFB_00020010: SMPpv1
# VFB_00020051: SLPal3
# VFB_00020052: SLPal4
# VFB_00020059: SLPal5
# VFB_00020031: PSp3
# VFB_00020071: VLPp2
# VFB_00020203: DM5 (cleaner)
# VFB_00020020: DM5 (messy)
# VFB_00020023: SLPpl2
# VFB_00020008 ALl1
vcinfo = vc.neo_query_wrapper.get_anatomical_individual_TermInfo([vfb_id])
image_folder = vcinfo[0]['channel_image'][0]['image']['image_folder'] + 'volume.obj'
image_folder

vfb_mesh = tm.load_remote(image_folder)
vfb_mesh
mesh_files = '/Users/yijieyin/Documents/Python/Pyroglancer/gal4_lines/' + vfb_id + '.ply'
mesh_files
tempval = vfb_mesh.export(mesh_files)

pcd = o3d.io.read_point_cloud(mesh_files)
pcd.estimate_normals()

# estimate radius for rolling ball
distances = pcd.compute_nearest_neighbor_distance()
avg_dist = np.mean(distances)
radius = 3 * avg_dist

# This will take some time. This is generating a point cloud from the nrrd file
mesh = o3d.geometry.TriangleMesh.create_from_point_cloud_ball_pivoting(pcd,
           o3d.utility.DoubleVector([radius, radius * 2]))

# create the triangular mesh with the vertices and faces from open3d
tri_mesh = tm.Trimesh(np.asarray(mesh.vertices), np.asarray(mesh.triangles),
                          vertex_normals=np.asarray(mesh.vertex_normals))

# Checks if the mesh is broken
tm.convex.is_convex(tri_mesh)

vfb_mesh = navis.Volume(tri_mesh)

jrc2018u_mesh = navis.Volume(flybrains.JRC2018U.mesh)
vfb_mesh.color = 'blue'
vfb_mesh
fig, ax = navis.plot2d([vfb_mesh,jrc2018u_mesh], method='2d')
fig.gca().invert_yaxis()
vfbmesh_xyz_02 = pd.DataFrame(list(map(np.ravel, vfb_mesh.vertices)), columns=['x', 'y', 'z'])
vfb2flywiremesh = copy.deepcopy(vfb_mesh)
# Transform from Janelia Research Campus 2018 Unisex into Flywire space
vfb2flywiremesh_xyz = navis.xform_brain(vfbmesh_xyz_02[['x','y','z']],source='JRC2018U', target='FLYWIRE')
vfb2flywiremesh.vertices = vfb2flywiremesh_xyz
vfb2flywiremesh

# You should always close this even if you shut down the terminal
startdataserver()
# An empty url containing the brain mesh
shorturl = 'https://ngl.flywire.ai/?json_url=https://globalv1.flywire-daf.com/nglstate/4757698205712384'

# just a random number to show in FlyWire
vfb2flywiremesh.id = 1
# Note the type here is volumes
# The link this cell gives is the one that has the pre-computed mesh.
shorturl = add_flywirelayer(flywireurl2dict(shorturl), layer_kws = {'type': 'volumes','name': 'DM5',
                                                        'source': vfb2flywiremesh,'color': 'white'})

# Make sure you run this at the end:
closedataserver()

Hi @YijieYin :
I had a detailed look at this issue:
While adding this mesh using pyroglancer produced the following figure in 3d:

If you carefully look the mesh is exceeding the neuropil boundaries at regions near medulla and anterior ventrolateral protocerebrum
Now if you go back to the vfb and look at the actual point cloud mesh, you can see below:
vfb link

you can see that the point cloud mesh (green) was not registered properly in regions near medulla (red) and anterior ventrolateral protocerebrum (red).
This is the primary issue for the mesh being not transformed properly.
Also if the points are closer to the neuropil boundaries, they would be a bit squished, you can see I have noted this problem before and have raised an issue a while ago here:
https://github.com/schlegelp/navis-flybrains/issues/2

So in conclusion, I would do the following to fix this issue:

Perform re-registration of the point cloud mesh DM5 clone again, and check if it fits well within the JRC2018U template.
Then try the pyroglancer again.
If steps 1,2 doesn't fix this, then ask for a solution to the registration at neuropil boundary issue with schlegelp/navis-flybrains#2

Re-referenced the issue to here: https://github.com/VirtualFlyBrain/VFB2/issues/310
The main problem seems to be the registration issue.

Further investigation reveals that some of these clones are actually registered to JFRC2 and not JFRC2018U template.
@YijieYin: It seems the prediction of @jefferis is right, in that these clones are indeed belong to the JFRC2 space.
For example, I downloaded VFB_00020020 from the virtualflybrain website and simply plotted them in the the JFRC2 neuropil.  See below:

Further, when I transform them to the flywire space and inject them using pyroglancer, they are well within the mesh:

i was quickly able to find a match like below after some probing:

So the part of the code that you need to change to achieve this transformation would be:
vfb2flywiremeshes['VFB_00020020'] = navis.xform_brain(vfbmeshes_dict['VFB_00020020'],source='JFRC2', target='JFRC2010')
vfb2flywiremeshes['VFB_00020020'] = navis.xform_brain(vfb2flywiremeshes['VFB_00020020'],source='JFRC2010', target='FLYWIRE')

The main issue seems to be that virtualflybrain mentions that the clones are aligned to JRC2018Unisex space in reality it seems they are aligned to JFRC2. So I think virtualflybrain needs to cross check and correct these references.
@Robbie1977: FYI


Stop cloning the index state

This drastically improves performance by no longer cloning the index
state, which only needs to be set once.
Resolves #197
Closes #199

@Byron Just tagging you because you might get a laugh at this. What a rookie mistake :facepalm:
Performance is now comparable to v0.6.0.

If this is a fix then I don't see it

The new State struct wrapped a gix::index::State. So cloning that state resulted in the index::State getting cloned for each file :upside_down_face:

I hope this will be fixed - it's not problem to achieve what needs to be done. Pretty please 🥺.

Yeah, please don't consider the merge an end to conversation. But this PR alone dropped gengo -R linux from about 90 seconds to 5 seconds locally, which feels significant enough for its own release. Cloning the attribute matches and stack might be bad, but cloning the index state was a really bad mistake I made in #191.

So this conversation doesn't get forgotten #202 :wink:


Poke CI to rebuild our 1.8 images.

Poke CI to rebuild our 1.8 images.

/cc @skonto

Depends on https://github.com/openshift-knative/serverless-operator/pull/2004.

Going to skip tests, as its a noop commit.
/override "ci/prow/410-e2e-aws-ocp-410"
/override "ci/prow/411-e2e-aws-ocp-411 "
/override "ci/prow/412-e2e-aws-ocp-412"

/override "ci/prow/410-e2e-aws-ocp-410"
/override "ci/prow/411-e2e-aws-ocp-411"
/override "ci/prow/412-e2e-aws-ocp-412"


switch to drone for ci

we already have one setup on gce at ci.cloudcustodian.io but we need to get it updated to latest drone version and hooked up to the repo/org.
this should significantly speed up builds, currently travis ci has a few issues wrt to pypy which means min 4m build times even though tests take 8s locally.

something seems to have changed wrt to the org config, yippee. we're now active with our own drone server (ci.cloudcustodian.io).


[NEXT] How can I get $i18n.localeProperties?

Fixed in v8.0.0-beta.2!
Please check it!

@kazupon In ^8.0.0-alpha.4 I have:

🤔

But alpha (4) is not beta (2) :thinking:

@dargmuesli Yes, thank you for your vigilance. I'm a little surprised it's already beta😅. My project crashed completely but localeProperties works fine now 😁.


Shows blank screen on open

I have added Big Calendar but it shows a blank screen. I have tasks in my Daily Notes and don't see any options to change this.

Same here

same here

Add:

Didn't work for me. Also, the moment I add ---, I'm in a "Properties" UI that seems to work differently from what your example suggests. The date field only allows a date, and the categories field doesn't seem to work the way you present it here.
I wrote it up in a separate text editor:

and then pasted it, and this is how it looks in an Obsidian note:

The "Big Calendar" is still blank.


Support sidecar injection for Pods, ReplicaSets, and/or CRDs

Can sidecar.jaegertracing.io/inject be done at a ReplicaSet or even Pod level? Or does must it only be a Deployment?
Allowing injection to happen at the lower level constructs would make it possible for jaeger-operator to integrate with CRDs (such as the Argo Rollout CRD) which users would use in lieu of a Deployment. For example, istio follows this model.
Based on https://github.com/jaegertracing/jaeger-operator/pull/473, it appears that jaeger-operator now uses mutating webhooks to perform injections, which means Pod level injection would work for everyone.

That's great feedback, @jessesuen! We decided to add support only for Deployments at first, to see if the approach would work. Apart from a couple of annoying things, it does work, so, we could certainly expand to other known types, like Pods.
That said, we are experimenting with a more standard approach, as described in the PR you linked. There are a couple of problems with that approach as well, such as setup complexity. Take a look at the changes to the README.adoc file in that PR, as it has an outline of all the steps required to get the automatic injection to work when using mutating webhooks.
For the record, @objectiser recently mentioned that Istio is moving away from webhooks, replacing their sidecar with a CNI plugin. This is also on our radar, but no work has started on that front yet.

I'm closing this issue, as I don't think there's any action we need to take here other than collect your feedback, but feel free to reopen if you think there's something else we should be doing.


Install SoS kernel

The package allows us to run different kernel in the same notebook, and also exchange data between different kernel. For example we can do run mlpack's logistic regression method with the C++ kernel, and plot the data with Python or create an interactive plot in JavaScript.
For some more details see https://vatlab.github.io/sos-docs/

Question: will this render all our utils along with matplotlib-cpp useless?

Not at all. This just provides convenience for folks who are used to using Python visualization libraries.
matplotlib-cpp shines because it handles the glue without needing a specialized kernel (SoS, in this case).

As the wise saying goes:
"LESGO!!"
~DaBaby.


fix(hook) - update when any values are not the same

Problem:
The useNameAndIcon hook did not update when the underlying information changed. We discovered this in the RenderAs component that lets you change the currently selected element or component to a different one.
Fix:
Changed the equality function to use and not or

@enidemi it might be worth to replace this equality function with a more structured combine5EqualityCalls one


peers-tab: bug fix right panel toggle

Initial Presentation:

When node row selected - panel is presented:

When network disabled - right panel is hidden:

What is this fixing?

What is this fixing?

Hiding the detailWidget is incorrect - hiding the right panel of the splitter view is the correct usage of the splitter view. This change uses the splitter view correctly.
Running the code will make what the change addresses readily apparent.

Hiding the detailWidget is incorrect - hiding the right panel of the splitter view is the correct usage of the splitter view. This change uses the splitter view correctly.
Running the code will make what the change addresses readily apparent.

@jonatack - thank you! yes - this is the goal! Part of a larger common initiative to make the peers tab contain more info and be more useful - a better use of GUI real estate. :) This PR is sparse - as to not break other work being done. :)

A UX note: to clear selection use Ctrl + click (actually, it inverses selection).

When no peer is selected, and one calls a context menu, it causes the peer selection with a layout change.
I found such a behavior distracting.


Android: this plugin clears all notifications after switching to background, even non-push notifications

My app uses cordova-plugin-music-controls. It displays an ongoing notification with music controls.
This plugin will clear that notification when switching to the background.
I know I can set android.clearNotifications to false. But I would like to keep this option.
I think this plugin shouldn't clear other non-push notifications. Otherwise there could be a conflict.

@shawnlan I need more info.
Sorry to be a jerk but I'm now closing issues that don't follow the issue submission guidelines. This plugin takes a lot of work to maintain and I can't afford the time required to solicit the required info from everyone.
I'm closing this issue but please feel free to re-open the issue if you provide the requested details from the new issue submission guidelines.
https://github.com/phonegap/phonegap-plugin-push/blob/master/.github/ISSUE_TEMPLATE.md


--task-id doesn't work for generating group-level report

After running the participant level mriqc and getting the report for individual runs, I wanted to generate separate group-level reports for each task I had (e.g., task-ER 5 runs, task-stroop 2 runs). I added the '--task-id ER -m bold' in the command but the group-level report I got still contained all bold data from all tasks.
After talking with Oscar, he suggested me to report an issue here.

Hi, Is there any update on this? I can't also get group level report for separate task or even session.

This should be doable now with the --bids-filter-file argument. Please reopen if I'm wrong.

Hi Oscar,
I tried the --bids-filter-file option without success. I use the latest mriqc 24.0.0 using a singularity build.
I have two tasks. I  created to json files:
reward:
{
"bold": {"task": ["reward"]}
}
Flanker:
{
"bold": {"task": ["flanker"]}
}
I used the command below #### in a bash script. Note that I renamed the generated output after each loop, as otherwise, the standard output names "group_bold.html" and "group_bold.tsv" are generated (e.g. the second loop overwrites the output of the first). So, initially, I thought that for some mystical reason, stuff was mixed after the second loop. Unfortunately, the result after renaming files is the same. The data of both tasks are mixed.
Did I misunderstand anything or use the wrong implementation? Is it because the individual data was generated
using mriqc.23.1.0? If so, should I rerun mriqc.24.0.0 on the individual data and, already at this level, use the --bids-filter-file option to create separate HTML/tsv files? In this case, will the output file names get the "task label" pre- or postpended?
##########
....
for task in reward flanker
do
filter="${SCRIPTS_DIR}/bids_filter_grouplevel_${task}.json"

catch_error singularity run --cleanenv --contain \
-B ${BIDS_TMP_DIR}/:/data_in \
-B ${SCRIPTS_DIR}/:${SCRIPTS_DIR} \
-B ${DERIV_DIR}/:/data_out \
-B /tmp:/tmp \
${mriqc_sif} \
/data_in \
/data_out \
group \
--session-id ${ses_label} \
--bids-filter-file ${filter} \
--no-sub \
--notrack \
-vv

# rename output

mv ${DERIV_DIR}/group_bold.tsv ${DERIV_DIR}/group_bold_${task}.tsv
mv ${DERIV_DIR}/group_bold.html ${DERIV_DIR}/group_bold_${task}.html

done
###########
I than used

@oesteban, could you reopen the issue? see my comment above

thanks!

@oesteban  I know you are busy, so I just wanted to know if there is a solution for this issue in the near future. If not, I just generate temporary bids directories for the separate fMRI tasks. Cheers

@oesteban
I know you are busy, so for now, I generated temporary BIDS directories for the separate fMRI tasks for creating group HTMLs for separate fMRI tasks.
However, it seems that when running mriqc on one bold series, the resulting individual HTMLs are not named using the input data name, in my case, sub-via297_ses-02CFINskyra_task-flanker_run-01_part-mag_bold.html, but instead sub-via297_ses-02CFINskyra_task-flanker_run-01_bold.html.
The effect of this is that when clicking on a data point in the group HTML, the associated HTML can not be loaded as it is looking for sub-via297_ses-02CFINskyra_task-flanker_run-01_part-mag_bold.html. Not a problem, as I just renamed the individual HTMLs, but do you have any idea when this functionality might work out of the box? Thanks in advance


⚠ Bofrost.at has degraded performance

In fca83cb, Bofrost.at (https://www.bofrost.at) experienced degraded performance:

HTTP code: 200
Response time: 2221 ms

Resolved: Bofrost.at performance has improved in 92195b3 after 6 minutes.


Incorrect row ordering in UI when using FlexColumn

Bevy version
0.4.0
Operating system & version
Ubuntu 20.04
What you did
When using the UI code, I found that the column flex direction appeared to give the opposite behaviour to what I expected (like ColumnReverse) and ColumnReverse appears to work like I would expect Column to do.   This is based on my understanding of how the CSS flex box works.
The following is a small example of the code that appears to have the issue:
use bevy::prelude::*;

fn main() {
    App::build()
        .add_plugins(DefaultPlugins)
        .add_startup_system(startup.system())
        .run();
}

fn startup(commands: &mut Commands, asset_server: Res<AssetServer>) {
    let font: Handle<Font> = asset_server.load("FiraMono-Medium.ttf");

    commands
        .spawn(CameraUiBundle::default())
        .spawn(NodeBundle {
            style: Style {
                flex_direction: FlexDirection::Column,
                ..Default::default()
            },
            ..Default::default()
        })
        .with_children(|parent| {
            spawn_text(parent, "first", font.clone());
            spawn_text(parent, "second", font.clone());
        });
}

fn spawn_text(parent: &mut ChildBuilder, str: &str, font: Handle<Font>) {
    parent.spawn(TextBundle {
        text: Text {
            value: str.to_owned(),
            font: font.clone(),
            style: TextStyle {
                font_size: 30.0,
                color: Color::BLACK,
                ..Default::default()
            },
            ..Default::default()
        },
        ..Default::default()
    });
}

What you expected to happen
I expected the text to be arranged in a column, with first above second.  Like:

What actually happened
The order of the rows was reversed, with second above first.  Below is a screen shot.

Additional information
I'm not sure if this is an issue with my understanding of my code, Bevy, or the upstream flex implementation.   Perhaps this is only occurring on my machine?
Using Flex column reverse:
style: Style {
                flex_direction: FlexDirection::ColumnReverse,
                ..Default::default()
            },

gives:

I believe this is because in bevy the origin is the bottom left corner, and y increases as you go up.

I believe this is because in bevy the origin is the bottom left corner, and y increases as you go up.

That is probably what is happening, but I wonder if this is the best behaviour?
I do agree that the bottom left corner is the correct place for the origin, and of course the co-ordinates of the UI should be the same as for the 2d camera, etc.  On the other hand, should the flex behaviour behave like the CSS flex?  I (obviously) thought that it would, but if not should this be documented? (of course I understand that documentation is not the priority now, but it did confuse me a bit).

That is probably what is happening, but I wonder if this is the best behaviour?
I do agree that the bottom left corner is the correct place for the origin, and of course the co-ordinates of the UI should be the same as for the 2d camera, etc.  On the other hand, should the flex behaviour behave like the CSS flex?  I (obviously) thought that it would, but if not should this be documented? (of course I understand that documentation is not the priority now, but it did confuse me a bit).

I also had this problem with expecting it to work like CSS - didn't even think of coordinates starting bottom-left when going through my code to try and find the issue.

I also had this problem with expecting it to work like CSS - didn't even think of coordinates starting bottom-left when going through my code to try and find the issue.

There is actually an underlying bug, that may or may not be hit. I believe from experimenting that it depends how children are inserted. If using with_children() then the bug doesn't trigger, but directly adding the Parent component triggers the bug. The bug itself is that the children order is not guaranteed. So yes, in the original example here with with_children() the issue was that Bevy uses a reversed vertical direction so for top-to-bottom ordering one should use FlexDirection::ColumnReverse. But in addition of that, one can use FlexDirection::ColumnReverse and still get random row ordering if inserting some children by adding the Parent component manually. And in that case, there's no way to control the order, and it makes the UI unusable.


Implement debugger data layer

Related Issues

#16

Changes

define required database tables by SQLDelight.
wrap SQLDelight queries with repositories.

Added Repositories

ClassInfoRepository: manages class information like properties, superclass, etc.
EventLogRepository: manage raw event data.

SessionInfoRepository: manage information about each session (connection).
SettingsRepository: manage each preference for the debugger app.

There is no enough code to test each repository. But, it's ok because specifications may change later.

I submitted this problem as an issue and will work on it later.
#28


How do I set start and end date range in the Calendar?

[ ] I have verified there are no duplicate active or recent bugs, questions, or requests
[ ] I have verified that I am using the latest version of CVCalendar.
[ ] I have given my issue a non-generic title.

Expected Behavior

Current Behavior

Possible Solution

Steps to Reproduce (for bugs)

Context

Your Environment

Version used (Cocoapods spec):
Device used i.e. iPhone 6S:
Physical device (y/n):
Link to your project (if available):

Please fill in the issue template.

I tried the following code but the calendar is staying in monthView when rotated. Any suggestions?
`   override func viewWillTransition(to size: CGSize, with coordinator: UIViewControllerTransitionCoordinator) {
super.viewWillTransition(to: size, with: coordinator)
    let isPhone: Bool = UIDevice.current.userInterfaceIdiom == .phone
    let isLandscape: Bool = UIDevice.current.orientation.isLandscape

    if isPhone && isLandscape {
        coordinator.animate(alongsideTransition: nil, completion: { _ in
            self.presentationMode()
        })
        }
    else {return}
    }

extension workoutLogViewController {
/// Required method to implement!
func presentationMode() -> CalendarMode {

    let isPhone: Bool = UIDevice.current.userInterfaceIdiom == .phone
    let isLandscape: Bool = UIDevice.current.orientation.isLandscape

    if isPhone == true && isLandscape == true {
        return.weekView
    } else {
            return .monthView
    }
}

}`


re-work to use the new package:js interop

(once the latest dev_compiler is published)

We'll be using the older interop initially.


Streamline the README(s)

To help the readability of the documentation, we might consider splitting the big unique README in a hierarchical fashion.

Done in commit
Last paragraph in separate files.


PACKAGES: mod-main, update Makefile to include gsheets data dump for test data

Depends on: https://github.com/getcouragenow/packages/issues/368

It looks like we are doing this work in #368, so this is an unnecessary issue


Typescript example not working

Hi there
I don't get anything to work.
Node 12.8.1
fastify 3.9.1
fastify-socket.io 1.0.1

If i just copy your example 1:1 and correct the import to 'fastify-socket.io':
Server listening at http://<IP_ADDRESS>:3000 the server starts.
But if i then try to connect to the websocket with

my client on ws://<IP_ADDRESS>:3000
or with Websocket Tester on ws://<IP_ADDRESS>:3000

nothing works. No success. No error. Nothing at all.
Also i am able to access the fastify server on port 3000. ergo no firewall problem.
The documentation is very small and frustrating. Please help.

Hi, while running the example if you visit http://locahost:3000/ you should see a message and in the fastify log you should see Socket connected.
It is a very basic example but if you have experience using socket.io you can just use fastify.io decorator exactly as if you were using the socketio instance.
Hope this will help but if you still have questions don't hesitate to ask :smiley:

Ok that is gross. Looks like Socket.io is not a normal socket-server.
It connects to /socket.io instead of just /. I don't know what magic is happening behind this monster but...
This is a thing that should be marked in fat red letters on the github socket.io page at the first line.
nerverless...
after finding this out i got cors problems while connecting to the socket server.
my app is running on port 3006 and tries to connect to localhost:3000  to socket.io.
i got fastify-cors registred but it seems socket.io is just ignoring this cors-plugin.
some googleing and i found out that socket.io has its own cors-functionality.
Thanks for your time and help. I got it working for now. but i think i will switch away from socket.io.
i'm wasting more time in figuring stuff out with socket.io than just going forward with basic websocket knowledge.

Yeah well happy to have been helpful.
I also configured my nginx to fit the /socket.io/ url.
Maybe I should also include that in a more detailed example.
Thanks for your explanation too.


Fix unscrollable body when returning to desktop mode from mobile mode with navigation drawer open.

So, this PR is related to this issue: #6200. Currently, BlueSky blocks the body scroll when the navigation drawer is opened: https://github.com/bluesky-social/social-app/blob/89c93313a3fc3123a2e53856f53cc8cea8e693fa/src/view/shell/index.web.tsx#L36
The problem is that when users switch to mobile mode, open the drawer, and then switch back to desktop mode, the navigation drawer is still considered open, which is incorrect. I’ve implemented a quick fix here to automatically close the drawer whenever the user exits mobile mode.

The data flow is kind of backwards here. We shouldn't be setting state in an effect based on some other state — we should instead make the value which decides whether to render the drawer (presumably it's above in this case) the source of truth (or contribute to the source of truth). Is that possible?

I think you can declare const showDrawer = !isDesktop && isDrawerOpen and then use that for the body scroll hook.

Oh thanks @gaearon for your feedback, I think that would be better. I have updated the PR.

thank you!


culturebox.francetvinfo.fr

Please follow the guide below

You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your issue (like this: [x])
Use the Preview tab to see what your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2017.11.15. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

[x] I've verified and I assure that I'm running youtube-dl 2017.11.15

Before submitting an issue make sure you have:

[ ] At least skimmed through the README, most notably the FAQ and BUGS sections
[x] Searched the bugtracker for similar issues including closed ones

What is the purpose of your issue?

[x] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue

If the purpose of this issue is a bug report, site support request or you are not completely sure provide the full verbose output as follows:
Add the -v flag to your command line you run youtube-dl with (youtube-dl -v <your command line>), copy the whole output and insert it here. It should look similar to one below (replace it with your log inserted between triple ```):
[debug] System config: []
[debug] User config: []
[debug] Command-line args: [u'-v', u'http://www.youtube.com/watch?v=BaW_jenozKcj']
[debug] Encodings: locale cp1251, fs mbcs, out cp866, pref cp1251
[debug] youtube-dl version 2017.11.15
[debug] Python version 2.7.11 - Windows-2003Server-5.2.3790-SP2
[debug] exe versions: ffmpeg N-75573-g1d0487f, ffprobe N-75573-g1d0487f, rtmpdump 2.4
[debug] Proxy map: {}
...
<end of log>

If the purpose of this issue is a site support request please provide all kinds of example URLs support for which should be included (replace following example URLs by yours):

Single video: https://www.youtube.com/watch?v=BaW_jenozKc
Single video: https://youtu.be/BaW_jenozKc
Playlist: https://www.youtube.com/playlist?list=PL4lCao7KL_QFVb7Iudeipvc2BCavECqzc

Note that youtube-dl does not support sites dedicated to copyright infringement. In order for site support request to be accepted all provided example URLs should not violate any copyrights.

Description of your issue, suggested solution and other information
Explanation of your issue in arbitrary form goes here. Please make sure the description is worded well enough to be understood. Provide as much context and examples as possible.
If work on your issue requires account credentials please provide them or explain how one can obtain them.

Carefully read new issue template and provide all requested information.

'''youtube-dl "https://culturebox.francetvinfo.fr/opera-classique/musique-classique/cantates-bwv-8-27-48-et-146-de-bach-par-raphael-pichon-27-265407" --verbose
[debug] System config: []
[debug] User config: []
[debug] Custom config: []
[debug] Command-line args: [u'https://culturebox.francetvinfo.fr/opera-classique/musique-classique/cantates-bwv-8-27-48-et-146-de-bach-par-raphael-pichon-27-265407', u'--verbose']
[debug] Encodings: locale UTF-8, fs UTF-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2017.11.15
[debug] Python version 2.7.12 - Linux-4.4.0-101-generic-x86_64-with-Ubuntu-16.04-xenial
[debug] exe versions: avconv 2.8.11-0ubuntu<IP_ADDRESS>, avprobe 2.8.11-0ubuntu<IP_ADDRESS>, ffmpeg 2.8.11-0ubuntu<IP_ADDRESS>, ffprobe 2.8.11-0ubuntu<IP_ADDRESS>
[debug] Proxy map: {}
[culturebox.francetvinfo.fr] opera-classique/musique-classique/cantates-bwv-8-27-48-et-146-de-bach-par-raphael-pichon-27-265407: Downloading webpage
ERROR: Unable to extract video id; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
Traceback (most recent call last):
File "/usr/local/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 784, in extract_info
ie_result = ie.extract(url)
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 437, in extract
ie_result = self._real_extract(url)
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/francetv.py", line 366, in _real_extract
r'"http://videos.francetv.fr/video/([^@]+@[^"]+)"', webpage, 'video id').split('@')
File "/usr/local/bin/youtube-dl/youtube_dl/extractor/common.py", line 800, in _search_regex
raise RegexNotFoundError('Unable to extract %s' % _name)
RegexNotFoundError: Unable to extract video id; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type  youtube-dl -U  to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
'''


Expose __destroy Subject

Could it be possible to expose Symbol(__destroy) Subject?
In our project we have some service which subscribes to a form, but we need to manually emit when to unsubscribe. Since we already use this library I tried to use its logic to help me with that.
I created this function that does the job
export const destroying = (instance: any): Observable<void> => {
  const key = Reflect.ownKeys(instance).find((key) => key.toString() === 'Symbol(__destroy)');

  return instance[key].asObservable();
};

There are two problems with this:

I am relying on library internals not to change
It's possible to change name using destroyMethodName?
Doesn't work without using untilDestroyed(this) (doesn't add property to component)

Would it make sense to expose it?

Hey @BojanKogoj . I don’t think it makes sense for libraries to expose internal stuff for specific use cases. Also, considering what you’ve described, I’m afraid that you may rely on the subject that doesn’t exist, I mean that subject can be changed, see “internals.ts”, where subject is assigned to null.
We could both think of a better API for that case so that would be public and would be understandable by end users.
I see the function that you’ve provided, could you show me some examples what are you doing and what are you solving? I do understand code better 😄

In component we call
this.foo.track(this.form.controls, destroying(this));

Foo being a service
track(controls, unsubscribe$: Observable<void>) {
  for (const key of Object.keys(controls)) {
    const control = controls[key];

    control.valueChanges.pipe(takeUntil(unsubscribe$)).subscribe((value) => {
      ...
    });
  }
}

Something similar to the above, there is a subscription to observable, that needs to be cleaned when destroying component with the form.

I’ve just checked the above example in the code and it works.

Yes, this should be fine.


Need script and directory tags in pxe_stack role

When deploying services like dhcp, tftp, http, dns etc. inside containers running on various bare metal nodes, we used the ansible "chroot" connector to generate the configuration files on a shared file system mounted on all nodes.
We want to use the standard roles (dhcp, dns, pxe_stack ...) for that purpose, but we do NOT want to start the services on the bare metal management node. So we use the template tag , but we need also for pxe_stack role to create the output directories and to copy the bootswitch cgi script. So, a directory and a script tag are needed for that.

Dear @jpm38 ,
Thank you for this proposal. I agree it would be a good feature.
Could you propose a PR based on branch 1.2.0 ?
Many thanks !
Ox

Dear @oxedions
Sounds goot to me.
JPM

Could you achieve the same behavior (don't start services) with --skip-tags "service"?

I've tested your proposal adding also the skip of "package":
--skip-tags package,service
and it does the trick.
thanks

Can we close then?

yes, sure

Closing.


Decide on release policy

Right now, master branch is live and changes are auto-published. By accepting PRs and not changing the content of VERSION, we’re breaking our Semver promise. New versions should at least get a patch version bump.
We can do one of three things:

Hold PRs for longer, and enforce the editing of VERSION when they are merged (and not after).
Introduce a new release (or similar) branch that actually pushes live, so we can accept PRs earlier.
Make publishing manual some other way.

In any of these case, I think we will want to prevent overwriting of previous releases, and potentially cause a failure when an overwrite is attempted.

PR #180 triggers a deployment error when new code is pushed to an old version.

The Pelias team has been using semantic-release for the past month to automate semantic versioning and publishing. @orangejulius has some feelings about it, both good and bad. Worth having a chat with him about it!

Yup, the TLDR is it has some confusing features (continuously annoying), is somewhat hard to set up (initially annoying and then not a problem), still requires some human action to use (annoying since it's easy to forget), but when it works, it prevents a whole host of human errors around npm publishing and so is pretty nice! Happy to talk more about it.

Is it just for npm releases? We’re mostly releasing to S3.

Yeah, it's specifically for NPM.

@hanbyul-here and I made a plan this morning:

The VERSION and CHANGELOG files will be the source of truth for release information.
We will edit those files manually; semver requires conscious decisions to be made about the impact of changes, and those files are where we will make them.
Having a release branch is annoying; it amounts to the same thing as editing version numbers.
Everything will happen on master, and the diff check in deploy.sh will ensure that no previously-released version is ever re-used.


Fix comparing IEnumerable in CachingJsonSettingsDatabase

Details of Changes

Fixes an issue where changed collections wouldn't update settings

Validation
How did you test these changes?

[x] Built and ran the app

Thank you!


[frontend] Support passing the optimization record file via the supplemental outputs map

The Swift driver is passing the optimization record file path via the supplementals output, instead of the flag, on certain circumstances.
Enhance the frontend to check supplemental outputs otherwise the record file will not get emitted when using the new swift driver.

@swift-ci smoke test


[Issue 13756][Broker] Optimize topic policy with HierarchyTopicPolicies about dispatchRate

Master Issue: https://github.com/apache/pulsar/issues/13756
Motivation
See issue: https://github.com/apache/pulsar/issues/13756
Modifications

Add field dispatchRate  in org.apache.pulsar.common.policies.data.HierarchyTopicPolicies
Methods to update dispatchRate  in org.apache.pulsar.broker.service.AbstractTopic
Other Modifications are concerning on org.apache.pulsar.broker.service.persistent.DispatchRateLimiter  where  dispatchRate are used

Verifying this change

[x] Make sure that the change passes the CI checks.

Does this pull request potentially affect one of the following parts:
If yes was chosen, please highlight the changes

Dependencies (does it add or upgrade a dependency): ( no)
The public API: (no)
The schema: (no)
The default values of configurations: (no)
The wire protocol: (no)
The rest endpoints: (no)
The admin cli options: (no)
Anything that affects deployment: (no)

Documentation

[x] no-need-doc

/pulsarbot run-failure-checks

/pulsarbot run-failure-checks

/pulsarbot run-failure-checks

@codelipenghui PTAL

@eolivelli Could you please help review this PR~

@codelipenghui PTAL

/pulsarbot run-failure-checks

/pulsarbot run-failure-checks

/pulsarbot run-failure-checks

resolve conflicting

/pulsarbot run-failure-checks


MNIST documentation makeover

I did remove some typos from the MNIST documentation and extended the description of the prompts to recreate the results. I also changed some of the formulations to make it more clear.
@smilesun if you don't like the new formulations you can also keep the old ones.

Codecov Report

Merging #266 (7f57f77) into master (2f3a413) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #266   +/-   ##
=======================================
  Coverage   95.43%   95.43%
=======================================
  Files         128      128
  Lines        4445     4445
=======================================
  Hits         4242     4242
  Misses        203      203

Flag
Coverage Δ

unittests
95.43% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.
:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Use systemd to start service when on debian 8

I tested this on EL7, debian 7 and debian 8. No changes are made on the 2 former platforms.
A couple of things to keep in mind:

as discussed on IRC, adding the support for debian8 to the test suite is out of scope, so currently there is no test coverage for this.
if a previous version of the module is used to setup elasticsearch on a debian 8 machine, systemd's LSB wrapper will take care of the service once systemctl daemon-reload has been run (which this module doesn't do before this patch, so someting else has to trigger this command)
if upgrading from a previous version of this module, /etc/init.d/elasticsearch-xyz will be left behind (unmanaged & undeleted)

Jenkins standing by to test this. If you aren't a maintainer, you can ignore this comment. Someone with commit access, please review this and clear it for Jenkins to run; then  say 'jenkins, test it'.

As discussed on IRC, i'll enable the tests as soon as i have a working Debian 8 docker image so i can actually test the changes :-)

Been successful in creating a debian 8 docker image.
Running the PR tests manually now.

Thanks for the review @sathieu & @electrical !
I just updated the patchset to properly support ubuntu.

@electrical here you go... :smile:
Sorry for the misunderstanding ! I aimed for avoiding duplicate statements over code clarity.

@mfournier thanks! i do agree that less code duplication would be nice, but sometimes having things explicit makes it easier to manage in the future.

jenkins, test it

@mfournier since you changed the path of where the service files are placed the rspec tests fail, could you fix that ? ;-)

Here you are @electrical. I just grepped through the spec directory but didn't actually run the tests. Hope I didn't miss any !
jenkins, test it (although I probably don't have the permission to invoke the bot...)

Jenkins, test it

jenkins, test it

@mfournier there seems to be still 1 error. Looks like you missed https://github.com/elastic/puppet-elasticsearch/blob/master/manifests/config.pp#L110 to change the path as well.
Cheers.

These tests appear to be worth the effort, great :-)
Fixed by d1c07e856. I hope we're OK now, @electrical.

jenkins, test it

@mfournier i'm merging it as is and will fix any other issues. Thank you so much for the contribution!

Wonderful, thanks !


The UI seems to lock up if you tap an infinite lazy seq

I've not looked into it, but I assume it's trying to display the whole thing. It might be worth detecting this and implementing some pagination or something??

This is on an JVM, using CIDER.
;; CIDER 0.27.0snapshot (package: 20200813.2112), nREPL 0.8.0
;; Clojure 1.10.1, Java 14.0.1

Doing something like this
  (require '[portal.api :as portal])
  (portal/open)
  (portal/tap)
  (tap> (range))

takes longer than my patience to return, and seems to stop me from running cider-quit.

Hi @l0st3d, this happens on the host side of things when the data is being serialized as transit before it's shipped up to the UI. I think if you (tap> (range)) in REBL, they truncate to 10k items, which would be a reasonable solution for portal as well. I tend not to run into this problem, so it isn't a priority for me right now, but if you'd like to submit a PR, I would be happy to review!

@l0st3d I changed my mind and went ahead and implemented a solution in #18

That seems like a reasonable solution too. Will have a test. Many thanks.
Just out of interest, how much effort do you think implementing pagination would be?

@l0st3d I just updated #18 to lazily fetch seqs. It does so in batches of 100. As you scroll, more data from the seq is fetched.


Fix broken auto-discovery tests

Auto discovery tests are broken. The test is reported as successful but it was not executed.
I would like to migrate it from swarm to something else e.g. wildfly? The other question is do we want to keep this test? It was useful when we didn't integrate with servlet filter now filter has to be added manually.

Correction the auto-discovery works the filter is discovered and added by container due to @WebFilter annotation.


Better packing

[ ] Make packing more readable: first pack positions and create a map, then pack additional quantities if needed
[ ] Packing is now wasteful memory-wise: for example, packing particles (2 float4) and density (1 float) will take the equivalent of 3 float4 times number of particles. New packing should store the objects in a more SoA fashion.
[ ] pack only what is strictly needed (interactions should ask for velocities for example)

See branch packers; need to reduce latencies


use with linux

Hi,
I got it working with the v1 API of a v2 influxDB - but only from a windos machine.
Now running the same on linux only produces timeouts.
Is there a known reason for this?
Thanks a lot!

Hi @rfrits, I haven't tried to use this library on Linux so unfortunately I'm not sure, but the Travis CI tests pass so I would expect it should work.
Would suggest reviewing the host and port configuration, or checking whether this Linux machine is connected to the right network and has access to the database.

Thank you.
Talked to my IT people.
Connection to database is checked with tcping, and port of database server is open.
Still no connection for the webwrite.
Will ask Influx people and Matlab people and hope for some hints there.


Add scripts for EMR launch with spark rapids plugin

Fixes #475
Adds automation around several steps related to the bootstrap and configuration of an EMR cluster with spark rapids plugin enabled.

@parthosa ptal, addressed comments

Hi @parthosa @kuhushukla , thanks for the update, we normally need to merge the pr to the dev branch(branch-24.12 ), can you please help revert the main branch and retarget the pr to branch-24.12? thx


Is this hosted?

I installed the app, but the bot doesn't seem to be running.
Do I need to create my own app and deploy it?

Hi @allanchau! It looks to be working to me! See: https://github.com/behaviorbot/update-docs/pull/14
Did you add your comment content's to a .github/config.yml file like so:
https://github.com/behaviorbot/update-docs/blob/828f8cfa99a7f17a70287fe76a1941c5e23592bd/.github/config.yml#L6-L7
If you don't specify comment contents, the bot won't run.

Strange, that is definitely there and merged into master.
I made a new PR with changes to the .github folder only, perhaps that is why it didn't run?

Do you have a link to the pr?

Sorry, it is a private repo.
This is the config.yml if that helps
updateDocsComment: >
  Oops, did you forget to update the documentation?
updateDocsTargetFiles:
  - CHANGELOG
  - README
  - docs/

Welp, that's my bad! I just sent out a permissions update so the app will work for private repos. It should work after you accept that :)

@hiimbex Seems it still isn't working for me 😢.
I also tried it on a public repo https://github.com/idearium/idearium-lib/pull/64/files
Does it need to be on master before it will start working?

Yea it needs to be on master.


3dMark01 hard crashes VMware workstation.

Trying to run the first lobby benchmark of 3dMark01SE under VMware workstation pro 17.0.2 build-21581411 causes the models to not appear and eventually crash the VM. Attached below is the log and screenshot.

3dmark err.log

Hi, models missing, because missing vertex shaders support. 3DMark 2001 + 03 works well only in VirtualBox with VMSVGA10 on.
The crash of the virtual machine should not happen, but it is possible that the graphics stack was confused enough to crash. Unfortunately, it is currently not possible to run 3DMark2003/03 in VMware :-(

Hi, is this meant with or without HW acceleration?

Hi, models missing, because missing vertex shaders support. 3DMark 2001 + 03 works well only in VirtualBox with VMSVGA10 on.

Asking because 3D Mark 2001 SE apparently has a failback. It shows lobby models with MaxShaderModelVS=0, HW acceleration enabled and VMSVGA10 on. Yet framerate varies a lot, like min 6 and peaking at 30-ish on my machine.


Provide Compatibliy for default Softmax axis

This fix is to provide compatibility for original Keras backend interface.
NOTE: TF1.5 is using CUDA9 and CUDNN7 by default while most machines
keep CUDA8 and CUDNN6.
Keras cannot launch TF<=1.4 correct that makes all models fail, e.g:
https://github.com/keras-team/keras/issues/9621
Signed-off-by: CUI Wei<EMAIL_ADDRESS>

The latest version of TF is 1.7. It is thus reasonable to only support 1.5 and higher for new features.
We are not breaking any code since axis in softmax is a new feature. It is important that simply upgrading Keras (without upgrading TF) should not break your Keras code, at least until you are ~3-4 versions late. This is the case here.


Removed scrolling part of lecture

 Thank you for your submission, we really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


added alt-text in waypoint seeds after it is taught

The alt-text for fcc-relaxing-cat was missing in the waypoint seeds after it was taught in "Add Alt Text to an Image for Accessibility"

Awesome! Thank you! :smile: In the future please make your changes in a branch named according to the Contribution Guide

Will do in the future. Thanks! :)


docs: Update README.md

Add Material Web Components for React

Thanks for the PR! At the moment we try to not have the list grow too big, so we have a soft minimum of 1k stars. Happy to revisit again in the future. I'll close this for now.


equation invalid in small numbers calculation

stringMath("1/1000000")  => 0.000001
but
stringMath("1/1000000000") gives equation invalid
Can there be a fix to this?
thanks

opened #2 to fix this


[Relay][Op] embedding_bag operator implementation

This PR adds a new operator that supports embedding_bag operator similar to torch.embedding_bag.
Co-Authored-By: Masahiro Masuda<EMAIL_ADDRESS>@shingjan @yelite
cc @blackkker

I took a quick look and this PR should be in pretty good shape after CI is fixed.
cc: @masahi Can you also take a look at this? Would really appreciate your review on this. Thanks!

@tvm-bot rerun

@areusch this should be closed by #12993


cephcluster: tune devices according to the deviceType

Signed-off-by: crombus<EMAIL_ADDRESS>

If I get it right, the deviceType can be set in the storageDeviceSet in the storage cluster yaml input. If this is set, this can override the otherwise potentially wrongly detected device type. I.e. it has to be set explicitly by the admin or whoever is crafting the input (GUI..). This PR is taking this specified device type and propagates corresponding OSD tuning settings to rook, in addition to (and overriding) the settings of PR #864 that enabled tuning settings based on known storage class types for backend disks. To be honest the code is getting more and more confusing. I suggest rebasing these changes on top of the refactoring of the tuning code in #946 which will make the resulting code more obvious and this change even shorter.
I further suggest to add this new code to the throttleStorageDevices() function (called checkTuneStorageDevices after the refactor), instead of directly to the ensureCephCluster() function.

Done the changes on top of the refactor code. I need suggestion to make it little better.

/test ci/prow/ocs-operator-ci

Now the bot has retriggered the ci runs, but before, ocs-operator-ci was failing in a strange way (already the second time on this PR):
https://prow.ci.openshift.org/view/gs/origin-ci-test/pr-logs/pull/openshift_ocs-operator/944/pull-ci-openshift-ocs-operator-master-ocs-operator-ci/1336353842756849664
First, it is failing in TestEnsureExternalStorageClusterResources like this:
     external_resources_test.go:76:
        	Error Trace:	external_resources_test.go:76
        	Error:      	Received unexpected error:
        	            	dial tcp <IP_ADDRESS>:13095: connect: connection refused
        	Test:       	TestEnsureExternalStorageClusterResources
    external_resources_test.go:194:
        	Error Trace:	external_resources_test.go:194
        	            				external_resources_test.go:78
        	Error:      	Received unexpected error:
        	            	storageclasses.storage.k8s.io "ocsinit-ceph-rbd" not found
        	Test:       	TestEnsureExternalStorageClusterResources
    external_resources_test.go:198:
        	Error Trace:	external_resources_test.go:198
        	            				external_resources_test.go:78
        	Error:      	Not equal:
        	            	expected: "device_health_metrics"
        	            	actual  : ""

        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -1 +1 @@
        	            	-device_health_metrics
        	            	+
        	Test:       	TestEnsureExternalStorageClusterResources
    external_resources_test.go:194:
        	Error Trace:	external_resources_test.go:194
        	            				external_resources_test.go:78
        	Error:      	Received unexpected error:
        	            	storageclasses.storage.k8s.io "ocsinit-cephfs" not found
        	Test:       	TestEnsureExternalStorageClusterResources
    external_resources_test.go:198:
        	Error Trace:	external_resources_test.go:198
        	            				external_resources_test.go:78
        	Error:      	Not equal:
        	            	expected: "myfs"
        	            	actual  : ""

        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -1 +1 @@
        	            	-myfs
        	            	+
        	Test:       	TestEnsureExternalStorageClusterResources
    external_resources_test.go:198:
        	Error Trace:	external_resources_test.go:198
        	            				external_resources_test.go:78
        	Error:      	Not equal:
        	            	expected: "myfs-data0"
        	            	actual  : ""

        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -1 +1 @@
        	            	-myfs-data0
        	            	+
        	Test:       	TestEnsureExternalStorageClusterResources
    external_resources_test.go:194:
        	Error Trace:	external_resources_test.go:194
        	            				external_resources_test.go:78
        	Error:      	Received unexpected error:
        	            	storageclasses.storage.k8s.io "ocsinit-ceph-rgw" not found
        	Test:       	TestEnsureExternalStorageClusterResources

but before that, there is a strange PASS:
 === RUN   TestCollectObjectStoreHealth
E1208 16:59:46.159345   11090 ceph-object-store.go:123] CephObjectStore in unexpected phase. Must be "Connected", "Progressing" or "Failure"
--- PASS: TestCollectObjectStoreHealth (0.00s)

Is this expected? :thinking:

now ocs-operator-ci has passed - strange flake...


MicroMasters Auth: update documentation to describe how to configure the system

Update documentation to describe how to configure mitX Online + MicroMasters to work together.
Note:
I suspect locally we might hit some issues here with devstack - specifically for the case that the user already has an account created in devstack for MicroMasters (or xPro for that matter), and they try to add an mitX Online authentication they will probably see an error back from OpenedX and their account creation will fail. This might require some hackery to get around but we should be clear in distinguishing that this is a local dev issue because in deployed environments MicroMasters and mitX Online won’t be running against the same (Open)edX deployment.

Note that we were tripped up by the lack of clarity about email validation. It needs to be turned off, possibly in both the django admin and in the edX feature settings. See https://mitodl.slack.com/archives/C02649X2P1V/p1629405256202900

We should note this in the xpro docs too.


Fix to handle as None when a request value is empty string

I tried to start test-project, but no data have shown. It seems datatables handles None instead of empty string. So it queries empty string as sql conditions as below.

Before fix

2015-07-29 09:11:39,313 INFO  [sqlalchemy.engine.base.Engine][Dummy-2] SELECT users.id AS users_id, users.name AS users_name, users.created_at AS users_created_at
FROM users JOIN addresses ON users.id = addresses.user_id
WHERE addresses.id > ? AND CAST(users.id AS VARCHAR) = ? AND CAST(users.id AS VARCHAR) = ? AND CAST(users.name AS VARCHAR) = ? AND CAST(users.id AS VARCHAR) = ? AND CAST(users.name AS VARCHAR) = ? AND CAST(addresses.description AS VARCHAR) = ? AND CAST(users.id AS VARCHAR) = ? AND CAST(users.name AS VARCHAR) = ? AND CAST(addresses.description AS VARCHAR) = ? AND CAST(users.created_at AS VARCHAR) = ? ORDER BY users.id ASC
 LIMIT ? OFFSET ?
2015-07-29 09:11:39,313 INFO  [sqlalchemy.engine.base.Engine][Dummy-2] (14, u'', u'', u'', u'', u'', u'', u'', u'', u'', u'', 10, 0)

After fix

2015-07-29 09:14:47,978 INFO  [sqlalchemy.engine.base.Engine][Dummy-2] SELECT users.id AS users_id, users.name AS users_name, users.created_at AS users_created_at
FROM users JOIN addresses ON users.id = addresses.user_id
WHERE addresses.id > ? ORDER BY users.id ASC
 LIMIT ? OFFSET ?
2015-07-29 09:14:47,978 INFO  [sqlalchemy.engine.base.Engine][Dummy-2] (14, 10, 0)

My environment is here.
(pyramid)$ python --version
Python 2.7.10
(pyramid)$ pip freeze
Chameleon==2.22
Mako==1.0.1
MarkupSafe==0.23
PasteDeploy==1.5.2
Pygments==2.0.2
pyramid==1.5.7
pyramid-chameleon==0.3
pyramid-debugtoolbar==2.4
pyramid-mako==1.0.2
pyramid-tm==0.12
repoze.lru==0.6
SQLAlchemy==1.0.8
-e git+git@github.com:t2y/sqlalchemy-datatables.git@1a6a562e01543e0ef1a6d48a3c9a13398746c22e#egg=sqlalchemy_datatables-master
test-project==0.0
transaction==1.4.4
translationstring==1.3
venusian==1.0
waitress==0.8.9
WebOb==1.4.1
wheel==0.24.0
zope.deprecation==4.1.2
zope.interface==4.1.2
zope.sqlalchemy==0.7.6

:+1:

done here #23 in 602ff48ca593ebd65cca7c38e896fb40e3d00871
Beware of the API break


Way to add Title above Quit in Windows demo?

Hello,
I here a way to add a "Title" that you cannot move the mouse over above the "Quit" in the example?
Thanks

Also, what about changing Text Fonts as well as Text Color foreground and background for a menu item?

Hello,
I here a way to add a "Title" that you cannot move the mouse over above the "Quit" in the example?
Thanks

Do you mean a tooltip?

I understand something like this

Yes, like the above is what I am seeking to do from the systray. I am guessing that the above image was not down with the Systray / Fyne library, but that would be awesome for my needs.
I will have a "Status" header that will show GREEN text if connected to the network, and RED if disconnected as one of the indicators, plus some others as well.
Thanks again and have a great day.

Support for custom content is not included because some OS don't support putting that in the menu structure.
You could use this library to handle just the icon and pop up a custom window which contains anything you want though...

Thanks and I will look into that more.


Correct names of Result's subclasses.

@fengdai Thanks! Forgot to change Readme when renamed interfaces


Dead link in BUILDING.md OpenCV 3.2 for Windows

OpenCV 3.2 for Windows

in BUILDING.md, is a dead link

AMD APP SDK 3.0 is also a dead link in the same file.


NumbaDeprecationWarning with latest dependencies, as "nopython" argument is not supplied to numba.jit

calling "embed" causes 4 or 5 of the same deprecation warning before any other output is printed.
Possible fix:
import warnings
warnings.filterwarnings("ignore", message=".*The 'nopython' keyword.*")

fix idea from here

Resolved by https://github.com/blab/pathogen-embed/pull/2/commits/00af5f768f90b80f6adb8da32dd0bc78b7b86245


Retry lazy loading

Hi,
At this moment we are using React.lazy, however, it is a time for SSR that is obviously not supported in React itself.
However, we are using this approach:
https://dev.to/goenning/how-to-retry-when-react-lazy-fails-mb5
If chunks load will fail.
I cannot adopt this function to @loadable/component.
This:
import {lazy} from '@loadable/component';
It does not return promise somehow. I am not sure but "loadable" function will return promise however, it does not support suspense.
Do you have any idea how to connect it together?
Best regards

That would not work with loadable-components by design. Wrapping import function with any third-party code would be:

ignored on SSR
might be ignored on the client side

such logic should be implemented using React Error Boundaries - lazy would throw on chunk failure, and you might just render it again (better in timeout) "retrying" loading.


Issue with k8s.io/docs/tutorials/hello-minikube/

This is a Bug Report

Problem:
The docs want me to enable the add-on heapster. But this add-on is not maintained anymore and when I was running the commands I got the error code enable failed: property name "heapster" not found
Proposed Solution:
Page to Update:
https://kubernetes.io/docs/tutorials/hello-minikube/

Latest minikube

/assign

@BorntraegerMarc yes minikube add on heapster is deprecated now ,so how would you like to update doc!
https://github.com/kubernetes-retired/heapster
Either we can update it with another example like minikube addons enable "add on name".
Or we can remove heapster from add on and add new list of add ons.

Execute minikube addons list on the latest minikube version 1.6.2 and I get this:
- addon-manager: enabled
- dashboard: disabled
- default-storageclass: enabled
- efk: disabled
- freshpod: disabled
- gvisor: disabled
- helm-tiller: disabled
- ingress: disabled
- ingress-dns: disabled
- logviewer: disabled
- metrics-server: disabled
- nvidia-driver-installer: disabled
- nvidia-gpu-device-plugin: disabled
- registry: disabled
- registry-creds: disabled
- storage-provisioner: enabled
- storage-provisioner-gluster: disabled

Don't know how it should be updated. I'm a total newbie :)
I guess if you want to portrait the add ons in this tutorial then any working add on will do the job.

It seems like the same as #18420

@BorntraegerMarc i have create the PR for the same and it's get merged.
Thanks

The issue was fixed by #18673
/close


Clear collections (to prevent multiple additions when running via metalsmith-browser-sync)

When serving via metalsmith-browser-sync collections' metadata gets filled with duplications of the same files over time. E.g. having 2 files in collection - after 5 reloads there are 10 files. To prevent this multiple addition behavior let's clear all collections' metadata right at the beginning.

The additional code on this pull requests fixed the issue I was having with browser-sync, thanks @petasittek. Would be good to see this pull request merged.

I have the same issue

What can we do to get this merged?

While it's not merged, Here is a dirty workaround I use to avoid this bug:
  .use((files, metalsmith, done) => {
    metalsmith._metadata.collections = null
    metalsmith._metadata.posts = null
    metalsmith._metadata.pages = null
    done()
  })

Put it before .use(collections({


sort methods to make api generations reproducible

There's actually a downside to this. When it comes to the spec, the order is meaningless. I can see why some people may want it ordered, but they don't necessarily want it alphabetically. We used to have a way to control ordering in the past, but since the order information was removed from the spec, we decided to take it out.
We appreciate the effort with the PR but are inclined to not merge it.

downside of not ordering is that naming of operations is different
e.g. there is two methods with same name from different subresources
e.g. method "getData": resource.getData, resource.subresource.getData
one of them gets operation name "getData" second  "getData_1",
and this depends on order of methods.
May be there should be configuration option to configure ordering of methods ?
like  JVM, NAME_ASCENDING in Junit @FixMethodOrder annotation

A solution has been implemented in #3740, see PR comment for details and usage scenarios. Closing this ticket, any further issues in this area should be reported in a new or not closed ticket.


Bump ClickHouse version to 0.7.0

Hi @Sunwards ,
good try, but versions over 0.3.2-patch11 have a problems with native-image compilation with out of the box library. It's reason why quarkus driver not updated yet.
mvn package -Pnative-image

Fatal error: com.oracle.graal.pointsto.util.AnalysisError$ParsingError: Error encountered while parsing com.clickhouse.data.ClickHouseCompressionAlgorithm.of(com.clickhouse.data.ClickHouseCompression)
Parsing context:
   at com.clickhouse.data.ClickHouseCompressionAlgorithm.of(ClickHouseCompressionAlgorithm.java:78)
   at com.clickhouse.data.ClickHouseCompressionAlgorithm.createInputStream(ClickHouseCompressionAlgorithm.java:56)
   at com.clickhouse.data.ClickHouseInputStream.wrap(ClickHouseInputStream.java:98)

Oh, got you, my bad, I didn't try to build native image)


fix camera roll lint warnings

fix lint warnings under Libraries/CameraRoll directory

@vjeux  - easy merge

@facebook-github-bot shipit


Inplace computation error with XBM

When I attempt to use XBM, I receive the following error. The encoder is a torchvision resnet34. It does use a number of in-place operations, but I am not sure why this is a problem.
Traceback (most recent call last):
  File "/home/andrew/siamese-classifier/train.py", line 252, in <module>
    train(
  File "/home/andrew/siamese-classifier/train.py", line 143, in train
    Quaterion.fit(
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/quaterion/main.py", line 101, in fit
    trainer.fit(
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 696, in fit
    self._call_and_handle_interrupt(
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 650, in _call_and_handle_interrupt
    return trainer_fn(*args, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 735, in _fit_impl
    results = self._run(model, ckpt_path=self.ckpt_path)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 1166, in _run
    results = self._run_stage()
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 1252, in _run_stage
    return self._run_train()
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 1283, in _run_train
    self.fit_loop.run()
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/loops/loop.py", line 200, in run
    self.advance(*args, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/loops/fit_loop.py", line 271, in advance
    self._outputs = self.epoch_loop.run(self._data_fetcher)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/loops/loop.py", line 200, in run
    self.advance(*args, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/loops/epoch/training_epoch_loop.py", line 203, in advance
    batch_output = self.batch_loop.run(kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/loops/loop.py", line 200, in run
    self.advance(*args, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/loops/batch/training_batch_loop.py", line 87, in advance
    outputs = self.optimizer_loop.run(optimizers, kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/loops/loop.py", line 200, in run
    self.advance(*args, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/loops/optimization/optimizer_loop.py", line 201, in advance
    result = self._run_optimization(kwargs, self._optimizers[self.optim_progress.optimizer_position])
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/loops/optimization/optimizer_loop.py", line 248, in _run_optimization
    self._optimizer_step(optimizer, opt_idx, kwargs.get("batch_idx", 0), closure)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/loops/optimization/optimizer_loop.py", line 358, in _optimizer_step
    self.trainer._call_lightning_module_hook(
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 1550, in _call_lightning_module_hook
    output = fn(*args, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/core/module.py", line 1705, in optimizer_step
    optimizer.step(closure=optimizer_closure)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/core/optimizer.py", line 168, in step
    step_output = self._strategy.optimizer_step(self._optimizer, self._optimizer_idx, closure, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/strategies/strategy.py", line 216, in optimizer_step
    return self.precision_plugin.optimizer_step(model, optimizer, opt_idx, closure, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/plugins/precision/precision_plugin.py", line 153, in optimizer_step
    return optimizer.step(closure=closure, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/torch/optim/optimizer.py", line 113, in wrapper
    return func(*args, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/torch/autograd/grad_mode.py", line 27, in decorate_context
    return func(*args, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/torch/optim/adamw.py", line 119, in step
    loss = closure()
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/plugins/precision/precision_plugin.py", line 138, in _wrap_closure
    closure_result = closure()
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/loops/optimization/optimizer_loop.py", line 146, in __call__
    self._result = self.closure(*args, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/loops/optimization/optimizer_loop.py", line 141, in closure
    self._backward_fn(step_output.closure_loss)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/loops/optimization/optimizer_loop.py", line 304, in backward_fn
    self.trainer._call_strategy_hook("backward", loss, optimizer, opt_idx)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 1704, in _call_strategy_hook
    output = fn(*args, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/strategies/strategy.py", line 191, in backward
    self.precision_plugin.backward(self.lightning_module, closure_loss, optimizer, optimizer_idx, *args, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/plugins/precision/precision_plugin.py", line 80, in backward
    model.backward(closure_loss, optimizer, optimizer_idx, *args, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/core/module.py", line 1450, in backward
    loss.backward(*args, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/torch/_tensor.py", line 396, in backward
    torch.autograd.backward(self, gradient, retain_graph, create_graph, inputs=inputs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/torch/autograd/__init__.py", line 173, in backward
    Variable._execution_engine.run_backward(  # Calls into the C++ engine to run the backward pass
RuntimeError: one of the variables needed for gradient computation has been modified by an inplace operation: [torch.cuda.FloatTensor [512, 256]] is at version 2; expected version 1 instead. Hint: enable anomaly detection to find the operation that failed to compute its gradient, with torch.autograd.set_detect_anomaly(True).

When I enable anomaly detection, the error changes to
Traceback (most recent call last):
  File "/home/andrew/siamese-classifier/train.py", line 252, in <module>
    train(
  File "/home/andrew/siamese-classifier/train.py", line 143, in train
    Quaterion.fit(
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/quaterion/main.py", line 101, in fit
    trainer.fit(
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 696, in fit
    self._call_and_handle_interrupt(
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 650, in _call_and_handle_interrupt
    return trainer_fn(*args, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 735, in _fit_impl
    results = self._run(model, ckpt_path=self.ckpt_path)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 1166, in _run
    results = self._run_stage()
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 1252, in _run_stage
    return self._run_train()
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 1283, in _run_train
    self.fit_loop.run()
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/loops/loop.py", line 200, in run
    self.advance(*args, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/loops/fit_loop.py", line 271, in advance
    self._outputs = self.epoch_loop.run(self._data_fetcher)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/loops/loop.py", line 200, in run
    self.advance(*args, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/loops/epoch/training_epoch_loop.py", line 203, in advance
    batch_output = self.batch_loop.run(kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/loops/loop.py", line 200, in run
    self.advance(*args, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/loops/batch/training_batch_loop.py", line 87, in advance
    outputs = self.optimizer_loop.run(optimizers, kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/loops/loop.py", line 200, in run
    self.advance(*args, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/loops/optimization/optimizer_loop.py", line 201, in advance
    result = self._run_optimization(kwargs, self._optimizers[self.optim_progress.optimizer_position])
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/loops/optimization/optimizer_loop.py", line 248, in _run_optimization
    self._optimizer_step(optimizer, opt_idx, kwargs.get("batch_idx", 0), closure)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/loops/optimization/optimizer_loop.py", line 358, in _optimizer_step
    self.trainer._call_lightning_module_hook(
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 1550, in _call_lightning_module_hook
    output = fn(*args, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/core/module.py", line 1705, in optimizer_step
    optimizer.step(closure=optimizer_closure)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/core/optimizer.py", line 168, in step
    step_output = self._strategy.optimizer_step(self._optimizer, self._optimizer_idx, closure, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/strategies/strategy.py", line 216, in optimizer_step
    return self.precision_plugin.optimizer_step(model, optimizer, opt_idx, closure, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/plugins/precision/precision_plugin.py", line 153, in optimizer_step
    return optimizer.step(closure=closure, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/torch/optim/optimizer.py", line 113, in wrapper
    return func(*args, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/torch/autograd/grad_mode.py", line 27, in decorate_context
    return func(*args, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/torch/optim/adamw.py", line 119, in step
    loss = closure()
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/plugins/precision/precision_plugin.py", line 138, in _wrap_closure
    closure_result = closure()
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/loops/optimization/optimizer_loop.py", line 146, in __call__
    self._result = self.closure(*args, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/loops/optimization/optimizer_loop.py", line 141, in closure
    self._backward_fn(step_output.closure_loss)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/loops/optimization/optimizer_loop.py", line 304, in backward_fn
    self.trainer._call_strategy_hook("backward", loss, optimizer, opt_idx)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/trainer/trainer.py", line 1704, in _call_strategy_hook
    output = fn(*args, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/strategies/strategy.py", line 191, in backward
    self.precision_plugin.backward(self.lightning_module, closure_loss, optimizer, optimizer_idx, *args, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/plugins/precision/precision_plugin.py", line 80, in backward
    model.backward(closure_loss, optimizer, optimizer_idx, *args, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/pytorch_lightning/core/module.py", line 1450, in backward
    loss.backward(*args, **kwargs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/torch/_tensor.py", line 396, in backward
    torch.autograd.backward(self, gradient, retain_graph, create_graph, inputs=inputs)
  File "/home/andrew/.cache/pypoetry/virtualenvs/imageclassifier-1EEfuA3P-py3.9/lib/python3.9/site-packages/torch/autograd/__init__.py", line 173, in backward
    Variable._execution_engine.run_backward(  # Calls into the C++ engine to run the backward pass
RuntimeError: Function 'DivBackward0' returned nan values in its 1th output.

Hello, @andrewaf1
Can you please provide your environment details and a minimal code snippet to reproduce this bug?

My setup is somewhat similar to the tutorial here https://quaterion.qdrant.tech/tutorials/cars-tutorial.html. I am using triplet loss and the Adam optimizer to train a model that consists of a pretrained Resnet-34 encoder and a skip connection decoder.
I am running on a Debian Google Cloud instance with a Nvidia GPU. Python 3.9.0 is installed via Poetry.

Any update on this @joein? Any more environment details I can provide?

Hi @andrewaf1,
It was not possible to reproduce the issue on my side. The provided error is expected when in-place operations used, but I can train other models with XBM. Currently, XBM has another issue because its memory usage gros exponentially (that will be fixed hopefully today), but it is not related to your case.
Could you please provide more details for me to try reproducing your case again?

Can you train the same model without XBM?
What is the source of pretrained Resnet34?
Is it trainable or not?
What are the exact arguments you pass to TripletLoss?

Thanks.

So this error goes away when I switch from hard or semihard mining to all... am I misunderstanding when I can use xmb?

Hi @andrewaf1, thanks for the info you provided!
Now that I reproduced the bug, and it is when Euclidean distance is used in the context of XBM --I verified that XBM can be used with Cosine distance without problems. You may want to use XBM with Cosine distance while I'm fixing the bug and releasing a patch. You may also consider upgrade your Quaterion installation, as we merged the new semi-hard implementation that has a better memory allocation.

Hi @andrewaf1, the fix to this bug was released in v0.1.34. You can update your installation and start using it.

Awesome, thanks! Just started using it.


Display numbers of rows in table

Hi Guys!
How do I show the number of rows in a table?
Additionally, I am using the search parameter to filter the table, so would like the number of rows to update as the table data is filtered.
Thanks =)

Solved.
http://allenfang.github.io/react-bootstrap-table/example.html#pagination
renderShowsTotal(start, to, total) {
return (

Total is { total }

);
}


RTK relative capabitity for the default hardware configuration on the Apollo D-Kit platform.

Hi,
One of my friends told me that by default the Apollo D-Kit hardware platform doesn't include the RTK relative hardware. So, the RTK relative capability in ApolloAuto should be unavailable for the default D-Kit suit sold by Baidu. Is this true? If this feature is required for my research project, how can I achieve this aim?
Regards
HY

I do not quite understand the meaning of "RTK relative capability".
Apollo localization is based on RTK, so the navigation device in D-KIT also support RTK. Meantime, you need to setup a RTK base station or buy a RTK base station service to enable RTK. And the base station related hardware/service is not included in D-KIT's scope.

Some of D-KIT users used qianxun FindCM service to get RTK capability. And you can access the service via 4G network.
Again, I strongly recommend to use the "D-KIT feedback tool" to raise any question about D-KIT :)

@diegohu Thank you very much for your suggestions and reply.


registry: Include image ID in ancestry

This is what the docker-registry does:
https://github.com/docker/docker-registry/blob/master/docker_registry/lib/layers.py#L50-L59

LGTM


Is there a Work-Around Planned for the HTTPS Update Failures?

Simply requesting update on whether a work-around is in place or is planned for the inability to update (youtube-dl -U) since the SSL-change?
Thanks.

Well seeing as how you couldn't be bothered to say anything definitive on the other ticket, it seemed reasonable to ask again.  If you don't care about fixing this just say so.