Poetry can't add DeepSpeed

Describe the bug
I am building a local project using poetry to manage dependencies poetry can't add DeepSpeed to the project part of the error seems to bee associated with torch installation installation - I have it installed.
Log output
AssertionError: Unable to pre-compile ops without torch installed. Please install torch before attempting to pre-compile ops
This error originates from the build backend and is likely not a problem with poetry but with deepspeed (0.9.2) not supporting PEP 517 builds. You can verify this by running 'pip wheel
--use-pep517 "deepspeed (==0.9.2)"'.
To Reproduce
Steps to reproduce the behavior:
poetry add deepspeed>=0.8.3
Expected behavior
add DeepSpeed to the project
Thanks

Thanks, I will try Pipenv

Hi @loadams, we also depend on Poetry and the latest DeepSpeed releases are still not PEP 517 compliant. We're porting our codebase to recent PyTorch and DeepSpeed is a blocker because version 0.8.0 relies on torch._six which latest PyTorch deprecated. Is there a timeline for DeepSpeed to support PEP 517? Thanks!

Hi @jorgetavares - to clarify, in order to use torch 2+, you need to use a newer version of DeepSpeed, so in order to update your system, potery requires DeepSpeed to be PEP 517 compliant?

@jorgetavares if you really must stick with the older version of DeepSpeed, you can also do a quick find/replace to make things compatible with the latest PyTorch. Here's a one-liner to do that:
find ./path/to/python/libs/site-packages/deepspeed/ -type f -exec sed -i -e "s|from torch._six import inf|from torch import inf|g" {} \;

Yes @loadams , that's the situation. However, we want to bring all packages to the most recent version possible. It's not like we want to upgrade some and keep others as is. DeepSpeed itself already has many releases since 0.8.0 so it should be also updated.
@mrwyattii thanks for the "hack" :) but I rather have DeepSpeed also updated and have things properly installed and not relying on manual fixes.

@AlongWY - those are just pre-built wheels for certain environments, they don't fix the requirements of the underlying DeepSpeed codebase not being PEP 517 compliant.


”L515“  Refer to the labview sample

Required Info

Camera Model
L515

Firmware Version
<IP_ADDRESS>

Operating System & Version
Win 10 Pro  -18362.1016

Platform
PC

SDK Version
Intel RealSense  SDK 2.0 (v2.38.1)

Language
C++

Issue Description
Hi, I want to get point cloud data in Labview many times, but it takes too long to get the existing dll, so I want to package a dll by myself. I wrote a sample program in VS with reference to the labview routine, but it can’t  obtain the depth map normally, The display window always closes directly，are there any steps missing?
using namespace std;
using namespace cv;
const auto window_name = "Display Image";
int main(int argc, char * argv[]) try
{
namedWindow(window_name, WINDOW_AUTOSIZE);
rs2_error** error = nullptr;
int i = rs2_get_api_version(error);
rs2_context* context = rs2_create_context(i, error);
rs2_device_list  *dev_list  = rs2_query_devices(context, error);
int j = rs2_get_device_count(dev_list,error);
rs2_device *dev = rs2_create_device(dev_list,0,error);
rs2_sensor_list *sensor_list = rs2_query_sensors(dev, error);
 int sensor_count = rs2_get_sensors_count(sensor_list,error);
 rs2_sensor *depth_sensor = rs2_create_sensor(sensor_list, 0, error);
 rs2_sensor *color_sensor = rs2_create_sensor(sensor_list, 1, error);
 rs2_stream_profile_list* depth_sream_list = rs2_get_stream_profiles(depth_sensor,error);
 rs2_stream_profile_list *color_sream_list = rs2_get_stream_profiles(color_sensor, error);
 int depth_stream_count = rs2_get_stream_profiles_count(depth_sream_list,error);
 int color_stream_count = rs2_get_stream_profiles_count(color_sream_list, error);
 const rs2_stream_profile *depth_stream_profile = rs2_get_stream_profile(depth_sream_list, 12, error);
 const rs2_stream_profile *color_stream_profile = rs2_get_stream_profile(color_sream_list,18, error);
 rs2_open(depth_sensor, depth_stream_profile, error);
 rs2_open(color_sensor, color_stream_profile, error);
 rs2_frame_queue*  depth_frame_queue = rs2_create_frame_queue(10, error);
 rs2_frame_queue*  color_frame_queue = rs2_create_frame_queue(10, error);
 rs2_start_queue(depth_sensor, depth_frame_queue,error);
 rs2_start_queue(color_sensor, color_frame_queue, error);
 while (waitKey(1) < 0 && getWindowProperty(window_name, WND_PROP_AUTOSIZE) >= 0)
 {
	auto depthframe = rs2_wait_for_frame(depth_frame_queue,5000, error);
	const int w = rs2_get_frame_width(depthframe,error);
	const int h = rs2_get_frame_height(depthframe, error);
  Mat image(Size(w, h), CV_8UC3, (void*)rs2_get_frame_data(depthframe,error), Mat::AUTO_STEP);

	imshow(window_name, image);
	rs2_release_frame(depthframe);
	}
rs2_close(depth_sensor,error);
rs2_close(color_sensor, error);
rs2_delete_device(dev);
rs2_delete_device_list(dev_list);
rs2_delete_context(context);
system("pause");
return EXIT_SUCCESS;

}`

Hi @cja-515
We will need to investigate although there currently is minimal support for Labview using L515.

I see that the code you wrote is partly C++ (due to auto)
Have you tried rs-imshow example? I think using C++ API for this task would be easier.

Hi    @dorodnic
Yes, I have tried the rs-imshow example, but the image is taken through the pipeline, I can not choose its image resolution, I can choose the image resolution for the labview example, but  the speed of taking pictures is too slow, so I want to try how long it takes to take pictures in C++ with the programming idea of Labview. If the speed of taking pictures in C++ is fast, I will pack a dll for taking pictures by myself. Could you please help me to see if there is an error in my program? Is it possible to select the resolution of the image when the image is taken by pipeline?

When can L515 support labview? @RealSenseSupport

Hi @RealSenseSupport
Just to resurrect the dead; has there been any movement regarding LabVIEW support for the L515?


Pooling driver command-line update

This PR implements a universal tensor descriptor command-line argument parser. The change allows deep customization of each tensor involved, including not supported yet configurations, striving to make the driver closer to the API of the library.
This is also required to test future transposed NHWC pooling.
This neither blocks nor requires #1296.
An example with the four pooling tensors:
--dinput  -D Dinput tensor descriptor.
             Format: NxC[xD]xHxW[,LayoutOrStrides]
             Default: input tensor descriptor
--doutput -H Doutput tensor descriptor.
             Format: NxC[xD]xHxW[,LayoutOrStrides]
             Default: output tensor descriptor
--output  -O Output tensor descriptor.
             Format: NxC[xD]xHxW[,LayoutOrStrides]
             Default: generated from input tensor descriptor
--input   -W Input tensor descriptor.
             Format: NxC[xD]xHxW[,LayoutOrStrides]
             Default: 100x3x32x32,NCHW

Good single character arguments have been taken already, so here we go.
Call examples:
MIOpenDriver pool --input 200x16x100x100
MIOpenDriver pool --input 10x10x10x10,NWHC --output 10x10x8x8
MIOpenDriver pool --input 10x10x10x10,1000x100x10x1 --doutput 10x10x8x8,NWHC

Some details on the argument format (NxC[xD]xHxW[,Layout|SNxSC[xSD]xSHxSW]):

The minimum amount of the details required to include in the provided tensor argument are lengths. If nothing else has been provided, the default layout is presumed, and strides are calculated based on that.
With layout string provided (like NCDHW or NHWC), strides are calculated based on that and lengths.
With strides provided, they are used as-is.

Pooling tensors calculation logic has been preserved except for a new ability to override all the tensors and layouts/strides. Also, spatial dims parameter is now implicitly calculated from the format of the input tensor descriptor.

@ce1adon @zjing14 What do you think about this?

This blocks pooling testing.


CTE ThreatConnect 1.1.1 - Added support to tag indicators based on th…

…e indicator type

Release Notes
Added support to tag indicators based on the indicator type


Single webm video / audio file playback issue

Hy!
First I would like to thank you for the great job on this library!
Using it with firefox 30 my problems are:

the recorded video (audio + video in webm) is playable only once. (I have to reload it if I want to replay)
the video player slider does not work, so I can't "navigate" through the video.

I can see your [demo] (https://www.webrtc-experiment.com/RecordRTC/AudioVideo-on-Firefox.html) has the same problems...
Do you have any idea of what is causing this behaviors ?
Weird thing is that the same video is playing well on Chrome (v34).... (you can replay it and navigate through video using the video player slider).
Regards.
Patrick
PS : I'm using RecordRTC.js last version (Last time updated at June 14, 2014, 08:32:23)

I think this is related to https://bugzilla.mozilla.org/show_bug.cgi?id=1068001


Add word analysis

In this pull request, the word analysis feature is added by using jieba.  We count all words whose length is greater than 1 and sort them in a B TreeMap. However, visualization is not implemented yet.
Signed-off-by: KernelErr<EMAIL_ADDRESS>

However, this implementation might not be good enough. Jieba only supports Chinese. And it does not support English very well, let alone other languages. :(

Nice, thanks @KernelErr. I think svg is the best format for word cloud visualization. If we google word cloud generator, you'll find most of it is rendered with svg.

Gotcha. I will try to render the word cloud this week. :)

Closed due to outdated code. I may work on this in later days.


Missing package diagrams from XMI

In the ISO 19156 XMI, there are two "package diagrams" that are at the top-level:

They are not currently rendered.
We want to have them rendered prior to the rest of the package contents.
<diagram xmi:id="EAID_AEC50F38_A8C6_4a7d_820E_A329C08BB579">
  <model package="EAPK_4542A7F6_7BC7_4218_8D91_4B799164C14A" localID="39079" owner="EAPK_4542A7F6_7BC7_4218_8D91_4B799164C14A"/>
  <properties name="External package dependencies" type="Package"/>

From @w00lf :

Currently we are rendering only child packages
we dont take into the account root package itself

These two diagrams belong to the root package.


Fixed #17

I have included the button in the navigation bar, which fits perfectly (right size).
If you insert <a href="/new"> [+] New Paste </a> inside navbar-nav, then the size problem occurs, otherwise the button fits perfectly.
Refer - https://github.com/twbs/bootstrap/issues/10917
Can you also specify what you mean by "usable" and "look good" in your description of the issue? Basing on that, I can either continue my work or not. Also, we'll wait till October to merge this code.

Thank you for the Pull Request. Indeed, this solves the problem. Can you make the button a btn-primary? Also, if you minimize the browser to say 400x800, the navigation bar collapses. This button then is accessible from the hamburger menu. Which of the following do you think looks better:

Current behavior
Button takes the full line of the menu
Button becomes label, just like "Pastes" and "About"

UPDATE -

I have the button a btn-primary

Also I think that the button should be there, but take the full line of the menu in mobile-device mode. It's the most formal and elegant way of displaying. I have made appropriate changes in the code to inherit that feature

Also, check that the bootstrap navbar collapses into mobile form when the width is 768px The height change doesn't really matter

I think this should be fine!

Thank you very much for this Pull Request! It seems very good now.

@DaKnOb This was my very first pull request to be merged actually :)
Thank you as well!
And, one quick question, will this count for the hacktoberfest?

@vijeth-aradhya Congratulations! It's good to see new people involved. That wasn't too difficult and it could take me a lot of time to fix it myself (as a matter of fact, I already spent some time 😄 ). It's also awesome to contribute to Open Source Software in general.
As for Hacktoberfest, I am not 100% sure it counts unfortunately. I think that you need to open 4 Pull Requests in October, so it will start counting the day after tomorrow. However, I'm sure there's going to be a lot of work similar to this to be done in this repository, so be sure to check back and your 4 Pull Requests will open very quickly!
Again, thanks a lot for your contribution!


Added a quickstart for APM,BROWSER,MOBILE,INFRA

Summary
A concise description of the changes being introduced. Please review the pre-merge checklist section to validate this pull request is ready for review and merge. If it is not ready, please mark the pull request as a draft.
The owners of this repo are not experts in the subject matter of the quickstarts. We review for the quickstart to be functional and for security risks. If you are seeking feedback on the content of the quickstart, please seek out a subject matter expert. If you are not an internal NR contributor, we can do our best to connect you with a content reviewer.

Pre merge checklist

[ Y] Did you check you NRQL syntax? - Does it work?
[ Y] Did you include a Data source and Documentation reference?
[ Y] Are all documentation links publicly accessible?
[ Y] Did you check your descriptive content for voice and tone?
[Y] Did you check your descriptive content for spelling and grammar errors?
[ Y] Did you review your content with a subject matter expert? (e.g. a Browser agent quickstart is reviewed with a member of the Browser Agent team)

Dashboards

[ Y] Does the PR contain a screenshot for each of your dashboards?
[ Y] Do your screenshots show data?
[ Y] Has the sanitization script been run on each dashboard?

Alerts

[ ] Did you check that your alerts actually work?

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

@pkudikyala FYI Let me know if I have any issues

thanks @aswanson-nr & @pkudikyala


PyPI wheel is outdated (Sep 10, 2018), though version number is the same

Currently only installing from the source gives the latest version of simglucose 0.2.1
The PyPI wheel is outdated and will produce undesired outcome.
This is not mentioned in the README.

Thanks! Just updated to 0.2.2


Symbolic link targeting an ancestor directory

Hi,
we discover some weird directory tree pattern in the build of a cxx bridge:

$ find . -follow -name foo
find: File system loop detected; './our_crate/target/debug/build/our_crate-1356a31d58aae0f3/out/cxxbridge/crate/our_crate' is part of the same file system loop as './our_crate'.

Because:

$ ls -ld ./our_crate/target/debug/build/our_crate-1356a31d58aae0f3/out/cxxbridge/crate/our_crate
lrwxrwxrwx 1 dbw users 59 Jan 25 15:10 ./our_crate/target/debug/build/our_crate-1356a31d58aae0f3/out/cxxbridge/crate/our_crate -> /dsk/hostname/username/Git/build/company_name/src/apps/our_crate

It seems odd to have a symbolic link pointing to an ancestor of the link.

This is intentional, what you are seeing is the include path give to the C++ compiler so that it understands what to do with #include "our_crate/path/to/header.h".
If you need those links to not be placed inside of the crate's source directory (which is Cargo's default) then you can make Cargo put the whole targets dir somewhere else by building with CARGO_TARGET_DIR=/path/to/somewhere/else.

@dtolnay Would it not be possible to simply copy the files instead of recursively symlinking?

I had a similar issue where my build system didn't cache the outputs of my cargo build, even with an out-of-source build directory, due to what it called a "reparse" point from the symlink back to the source directory.
I realized those symlinks are not needed after the cc build is done. I've only used this on Windows, and it's potentially destructive so make sure you have everything in source control before you use it, but I just put a call to this function in my build script after each compile("lib_name") call, parameterized on the crate directory name:
use std::env;
use std::fs::remove_dir;
use std::path::PathBuf;

pub fn clean_symlinks(crate_name: &str) {
    let out_dir = env::var("OUT_DIR").unwrap();
    let mut crate_dir = PathBuf::from(&out_dir);
    crate_dir.push("cxxbridge");
    crate_dir.push("crate");
    crate_dir.push(crate_name);
    remove_dir(crate_dir).expect("failed to remove the symlink created by cxx");
}

There's code in this repo which cleans up the symlinks in preparation for creating new ones, and it has lots of platform checks and some branches on Windows depending on the target (file or directory) of the symlink. Like I said, I've only use this on Windows, and I know the target of the symlink is a directory, so this is simplified for my use case. I recommend looking at best_effort_remove if you need to handle anything more complicated.

...and yes, this is a total hack that's coupled to an implementation detail of this crate at this specific version. 😄 No warrantee is expressed or implied.


Improve our job execution model

Right now job sharding is very static, we compute how many shards we want to run before we start the job and create a k8s job with that much parallelism. Each of these jobs gets handed a chunk of work when start up and contact pachd. If each of the pods doesn't run their chunk of work to completion you get weird failure modes. For example if a pod dies then it will get rescheduled by k8s but when it contacts pachd it will get an error because the job already has too many pods. Meanwhile the shard it was processing will never be reassigned so
We can fix this with a lease based model, this would make it so that even if one of the pods fails pachd can reassign the chunk of work it was doing to another pod. This also allows us to do some smart optimizations like if a lease expires on a shard we can split it up into 2 smaller chunks and schedule those. In theory if our logic in there got smart enough users wouldn't have much reason to specify parallelism for their jobs and could just rely on the system to figure it out for them.

Closed by #1022


Broken diagram generation in 7.0.0

A diagram that was working in 6.5.0 seems to have stopped working in 7.0.0.
Attached samples seem to show the only non-whitespace change is this:
diff --git a/6.5.0.txt b/7.0.0.txt
index 0deb9ac..47206d1 100644
--- a/6.5.0.txt
+++ b/7.0.0.txt
@@ -98,7 +98,7 @@
             "idx": 0,
             "definition": [
               {
-                "type": "Flat",
+                "type": "Alternative",
                 "definition": [
                   {
                     "type": "Terminal",
@@ -109,7 +109,7 @@
                 ]
               },
               {
-                "type": "Flat",
+                "type": "Alternative",
                 "definition": [
                   {
                     "type": "Terminal",
@@ -120,7 +120,7 @@
                 ]
               },
               {
-                "type": "Flat",
+                "type": "Alternative",
                 "definition": [
                   {
                     "type": "Terminal",

6.5.0.txt
7.0.0.txt
(Rename .txt -> .html)

Thanks for reporting this, I must have missed something in the renaming of Flat to Alternative

@danhawkes please try version 7.0.1 (out on npm).
Cheers.

Yep, that's fixed it! Thanks for the quick response.


Nav Bar gets Black when Scrolling

Thanks for the library. I've been using AMScrollingNavbar successfully for the last period of time. However, now I added support for empty views using this library: DZNEmptyDataSet*.
By doing this, whenever I show an empty view, then load some data in the table, the navigation bar gets black when scrolling. Whenever it finishes scrolling (it fully disappears or appears), everything gets back to normal. Any ideas?
Normal Navigation Bar:

Navigation Bar When Scrolling:

Hey @florinzf
Can you provide a simple demo project showing this issue to help me debug it?

Hey. I'm still struggling to replicate it in a different project. Turns out, simply adding the DZNEmptyDataSet library wasn't enough, although this is what triggered the problem in the main project.
In the meantime, if you have any ideas on what I could try changing, that'd be great. Thanks!

I never used DZNEmptyDataSet. On top of my mind it might be something related to a gesture recognizer (if DZNEmptyDataSet has its own to implement a pull to refresh or whatnot).
But it's tricky without a project to debug :)

showing black navigation bar while moving up ui table view controller

help

Please @khaskheli24 report a proper issue with a proper description, and if possible a working sample for me to debug.

As an update on this, the problem became permanent when I added a custom refresh control.
Adding the same refresh control in a separate project, did not help replicating the issue... I had to deactivate the scrolling effect all together.
I spent quite some time trying to debug this with no luck. Any suggestions on what I could look at? Any flags to put in the code?

We were having the same issue (or at least the same symptom ;). We have a really simple ScrollingNavigationViewController (essentially just an empty controller) that contains a ScrollingNavigationViewController which has a WKWebView in it. We initialize the WKWebView frame to the size of the default view's frame (so it fills the entirety of the visible space below the nav bar). The black bar was appearing since the size of the WKWebView was not being updated as the nav bar scrolls off the screen. In other words, the black bar that appears is vacant, un-rendered space without a view.
In our case, the fix was easy: we just had to add the WKWebView itself as a follower:
if let navigationController = navigationController as? ScrollingNavigationController {
    navigationController.followScrollView(self.webView.scrollView, delay: 50.0, scrollSpeedFactor: 1, followers: [self.webView])
}

With that in place, the WKWebView now properly scrolls "with" the nav bar.
@andreamazz are you able to confirm this is the proper approach to address the problem in this scenario?
@florinzf perhaps this information is helpful to your scenario?

@brianlenz
Thanks for sharing your experience, that's really helpful. Yeah, I think that's the right approach, it'd be worth updating the sample project for the webview using this solution.

this doesn't work properly. you will get a black bar issue in some setups. Don't add a follower.
keep your code as
navigationController.followScrollView(self.webView.scrollView, delay: 50.0)
The fix I have is that I set the tableview/webview top constraint to superview, then enable adjust scroll insets. Have extended under top and bottom bars checked too. This should fix everything.

Yeah, you're right. PR #239 fixed this for us, as well, by supporting WKWebView in addition to UIWebView.

It'd be great if you guys could create a small debugging post for swift 3. I wasted a lot of time with weird inset bugs.

So I'm still having a bug with wkwebview - now having a black/white bar underneath. any ideas?

I have the same issue :(

extendedLayoutIncludesOpaqueBars = true in viewDidLoad and .backgroundColor = <your color> solved this issue for me.


Add py-shiny to downstream tests in CI

This has happened: https://github.com/posit-dev/py-shiny/pull/1570#event-14510042638
So we now need to test all commits against their test suite to make sure we don't break anything for them

Thank you!


$addToSet and $pull objects being inserted into Elasticsearch

I'm having an issue where mongo-connector is sending entries from the oplog that include $addToSet and $pull attributes. These documents are destroying my mapping (I have custom date formats declared), and eventually lead to errors and mongo-connector crashing.
Before I upgraded my cluster to v2.2.0 and mongo-connector to 2.3, I did not have these issues and mongo-connector was working like a champ. I'm not sure if these kinds of oplog entries were handled before, but it'd be great to get a rundown on that and if this issue is caused by the mongo-connector 2.3/elastic2_doc_manager upgrade or an issue with mongo.
I'm currently running:

mongo-connector 2.3
elastic2-doc-manager 0.1.0
mongodb 2.2.7
elasticsearch 2.2.0

Example of a doc containing $addToSet
{
    "ip_data": {
        "3": {
            "web_published": false
        }
    },
    "$addToSet": {
        "ip_data": {
            "web_published": true,
            "seen_first": "2016-02-18T15:43:56.114000",
            "active_last_seen": "2016-02-18T15:43:56.114000",
            "seen_last": "2016-02-18T15:43:56.114000",
            "version": "IPv4",
            "_id": "[redacted]"
        }
    }
}

Example of a doc containing $pull
{
    "$pull": {
        "ip_data": {
            "_id": "[redacted]"
        }
    }
}

Hello!
I'm looking into this now. What server configuration do you have? Are you using a replica set or a sharded cluster?

The mongo instance isn't managed by me, but I believe it's using replica sets. If there's a command I could run to get those details, I can do that.
Just curious, what does mongo-connector do if it runs into an item with $addToSet, but that original doc isn't in ES? Does it just throw it out? I don't have the data fully replicated, so the docs that have $addToSet might not exist yet.

Also, are these example docs in MongoDB or in your MongoDB instance or only in Elastic? If not, what do the documents in MongoDB look like?

So mongo contains everything, and I'm trying to replicate a mongo collection in elastic.
The mongo doc correlating to the doc in the intial post is below.
{
  "_id" : "[redacted]",
  "first_seen" : "10/10/2014 16:40:55",
  "ip_data" : [{
      "_id" : "[redacted]",
      "version" : "IPv4",
      "seen_first" : "10/10/2014 16:40:55",
      "seen_last" : "10/10/2014 16:40:55",
      "web_published" : false,
      "active_last_seen" : "10/10/2014 16:40:55"
    }, {
      "_id" : "[redacted]",
      "version" : "IPv4",
      "seen_first" : "2/18/2016 10:43:56",
      "seen_last" : "2/18/2016 10:43:56",
      "web_published" : true,
      "active_last_seen" : "2/18/2016 10:43:56"
    }]
}

This exists in mongo, but not yet in elastic, and the doc in the original post ends up getting indexed.

Hello!
Would it be possible for you to run:
db.getSiblingDB("local").oplog.rs.find({"o.$push": {"$exists": true}}).toArray()
and
db.getSiblingDB("local").oplog.rs.find({"o.$addToList": {"$exists": true}}).toArray()
on your mongo instance? Its possible that this query might take awhile since the oplog doesn't have indexes. If it returns a large list I only need a few documents, since it's probably the same thing that's happening for every operation.
Thanks for your patience!

When I try to run those, I get this error:
error: { "$err" : "can't use 'local' database through mongos", "code" : 13644 } at src/mongo/shell/query.js:128

Not sure what's causing that, any ideas?

You need to connect directly to each of your shards in order to query the oplog.
How long have you been running MongoDB 2.2? Are you certain that every part of the cluster is running 2.2?
The reason I'm asking is that in order for you to have $addToSet or $push show up in your elastic instance, they would have to come from your mongodb oplog.  After MongoDB 2.2.7, the oplog can only contain idempotent operations - i.e. $set and $unset. The only way to get $addToSet or $push in your oplog is if you used those commands before upgrading to 2.2.7 and you have either a very large oplog or a replset with very low usage (because the oplog rolls over).
Mongo-Connector only supports MongoDB version 2.4 and later, so when reading the oplog we only check for $set and $unset in update operations. Update operations without either $set or $unset are treated as replacements, which is why the entire $push/$addToSet update command is getting treated as a document.
Hopefully we can come up with a way to get around this issue, but I don't know why this would be coming up when you update your elastic instance because this issue existed in the last elastic doc manager. I also am not sure why you've got old-style oplog operations if you've been running 2.2.7 - how big is your oplog? How often are operations being done on your collections?
Thank you!

So the mongo cluster isn't managed by me, we just have a mongos instance for our own use, but we don't house the actual cluster data. It makes it tough to answer some of the more detailed questions like oplog size and whatnot, unless I can grab that using the cli and some command.
I did run the command you sent above on the mongos instance, but I guess since it's not a shard it didn't work. However, mongo-connector was working prior to me updating everything, and either those $push/$addToSet commands didn't exist or they were ignored. Before the update, I pulled down ~600m documents in a little less than a week, if that could help determine the oplog operation count.
When mongo-connector read the oplog, does it read newest-oldest? If so, it's completely possible that the oplog is large and the operations are low, which is why after 600-700m documents it's hitting these operations.

Of course, if there's any way for me to get info about the oplog with mongo cli, let me know and I can run the commands.

How are you running mongo-connector if you only have access to the mongos?

I'm running it on the same machine as mongos, and it was able to connect. I'm not entirely sure about how the oplog works - mongos doesn't get updates for it? Could it be mongos is running as a replica set member and it's getting oplog updates that way?

Also, if it helps any, the dates on the documents that are being sent with the $push/$addToSet commands have timestamps that are within the past month, so that rules out the old document theory.

In order to work mongo-connector needs to be able to access the shards. If you run sh.status() on the mongos, you can find the addresses of the shards. Can you connect directly to these addresses?

Unfortunately no I cannot, since we don't manage them. I'm just curious how it was working before.. and how it didn't error out when trying to run mongo-connector.
Just to make sure, the person who set up the mongos instance said this is what we're using to connect to the cluster.
And the command is below:
mongos --configdb [configserver1], [configserver2], [configserver3] --port 4000

From there, I use localhost:4000to connect either with mongo-connector or the mongo cli

@joshporter1, you can actually access the shards directly. If you couldn't mongo-connector wouldn't work, since it has to be able to directly connect to the shards to replicate data to the target system. It can't do that work though mongos. Please run sh.status(), connect to the primary of each shard listed in the "shards" list, and run the queries @aherlihy asked about earlier.
Also, can you tell us what version of mongo-connector you were using before you upgraded to 2.3? And also what version of Elasticsearch you were using before upgrading to 2.2.0?

I misunderstood and thought I required ssh access to those servers, but I understand now. Sorry for the confusion - I'm working on connecting and running those queries now, and I'll post back with the results once the queries finish - they are taking quite a while!
As for the versions before the upgrades...

elasticsearch - 1.7.1
mongo-connector - 2.2 - I installed it about a month ago

Example $addToSet oplog docs
[
  {
    "ts" : Timestamp(1441312887, 31),
    "h" : NumberLong("-111720189895634896"),
    "op" : "u",
    "ns" : "domains",
    "o2" : {
      "_id" : "sample1.domain.com"
    },
    "o" : {
      "$addToSet" : {
        "ip_data" : {
          "_id" : "2a00:1450:400f:805:0:0:0:2001",
          "version" : "IPv6",
          "seen_first" : ISODate("2015-09-03T20:41:26.814Z"),
          "seen_last" : ISODate("2015-09-03T20:41:26.814Z"),
          "web_published" : true,
          "active_last_seen" : ISODate("2015-09-03T20:41:26.814Z")
        }
      }
    }
  },
  {
    "ts" : Timestamp(1441312887, 32),
    "h" : NumberLong("4009748812559340465"),
    "op" : "u",
    "ns" : "domains",
    "o2" : {
      "_id" : "sample2.domain.com"
    },
    "o" : {
      "$addToSet" : {
        "ip_data" : {
          "_id" : "<IP_ADDRESS>",
          "version" : "IPv4",
          "seen_first" : ISODate("2015-09-03T20:41:26.856Z"),
          "seen_last" : ISODate("2015-09-03T20:41:26.856Z"),
          "web_published" : true,
          "active_last_seen" : ISODate("2015-09-03T20:41:26.856Z")
        }
      }
    }
  },
  {
    "ts" : Timestamp(1441312887, 38),
    "h" : NumberLong("-3657870658006369788"),
    "op" : "u",
    "ns" : "domains",
    "o2" : {
      "_id" : "sample3.domain.com"
    },
    "o" : {
      "$addToSet" : {
        "ip_data" : {
          "_id" : "2a01:1250:300f:802:1:0:0:2101",
          "version" : "IPv6",
          "seen_first" : ISODate("2015-09-03T20:41:26.856Z"),
          "seen_last" : ISODate("2015-09-03T20:41:26.856Z"),
          "web_published" : true,
          "active_last_seen" : ISODate("2015-09-03T20:41:26.856Z")
        }
      }
    }
  }
]

I wasn't able to find any $push docs on any of the shards, and I did notice there were drastically less of those, so perhaps they got rolled off.

I think you have pre-2.2.1 servers running in your cluster. The only way $addToSet could possibly end up in the oplog is to use pre-2.2.1 servers.
Like I mentioned before, Mongo-Connector only supports MongoDB version 2.4 and later, and since the oplog entries you have are from an earlier version, we are not going to add support for this.

Ah, you're probably right. I still don't know why it worked in the older version, but oh well. Thanks anyways!
If I were to try to modify mongo-connector to ignore/skip documents that have anything except $set/$unset, would that be possible or a viable workaround? Just curious if I should bother or just scrap using mongo-connector altogether since there's old versions of mongo in the cluster.

It depends on your use case. As I mentioned earlier, documents without $set/$unset are treated like replace. If you were to ignore all oplog operations with $-operators that aren't set/unset, then those documents would never make it into elastic search. This might work for your application, it might not.
This could be a good place to start.

I'll definitely look into that. I'd love to get mongo-connector/es2 doc manager working with docs from this old mongo cluster. Thanks again for your help! :)

Hello again, just one quick question. I was trying to look into the history of the original elastic-doc-manager and noticed there is no history. Is there any way for me to see this file before you upgraded it to support es2, and before you split the repo into es and es2 doc managers? Thanks!

http://stackoverflow.com/questions/2952507/can-github-show-the-history-of-changes-made-to-one-file-in-patch-form

Yes, I did that but it doesn't appear to have any history. Link

https://github.com/mongodb-labs/mongo-connector/commits/master/mongo_connector/doc_managers/elastic_doc_manager.py

Perfect, thank you. Didn't realize it was in that repo.


channel error when using bilateral_filter_calculator

Hi there,
I tried to add the bilateral filter in my segmentation task. Following channel number error raise:
"CPU filtering supports only 1 or 3 channel input images."

I checked my input channel is 1 (output from selfie segmentation task)...
Then I found this line in bilateral_filter_calculator.cc
https://github.com/google/mediapipe/blob/ecb5b5f44ab23ea620ef97a479407c699e424aa7/mediapipe/calculators/image/bilateral_filter_calculator.cc#L243
It seems like a "!“ is missing in the code.

Hi,
Thanks for bringing this to our attention. This is indeed a bug, and has now been fixed upstream. The next release of MediaPipe should contain the update.
Cheers

Hi @carter54, From the above comment we are closing this issue as of now and I would request you to test the above once the new release roll out. Reach us back if you still face the same.


[5.6] Add some model event handlers

Added model event handlers for following events,

incrementing
incremented
decrementing
decremented

Thanks for the PR. What's your use case for this please?

Thanks @GrahamCampbell. Here is my use case,
We are working on the system which manages orders of several restaurants. These restaurants share same menu with our system. So we've to maintain the total number of orders per menu item and number of orders with particular restaurant of specific menu item. Here, each restaurant acts as a user which has an API for approving or denying the order.
I had to log every database activity of each user. So I chose Observer for logging the activities. And I'm using Increment & Decrement for increasing and reducing count of total orders and restaurant orders. But I observed, these events are not getting handled as all others are being. So I added those four event handlers ( incrementing, incremented, decrementing and decremented ).
Thanks.

Just write a class where you call increment and do whatever you want within that class. We don't need framework hooks for this.


Volunteering for  f18

Name

Cindy Choi

Role / Title / Company

Currently looking for work

Availability

[x] I'm available all day (7:30 AM - 9:00 PM)
[ ] I'm only available in the AM (7:30 AM - 12:00 PM)
[ ] I'm only available in the PM (12:00 PM - 9:00 PM)
[ ] Other… (please specify)

Type of activities you can be involved in

Everything is already planned, booked and coordinated, we're just looking for humans to help scale at the day of the event

[x] Ticketing & Check-in
[x] General Guidance, Q&A
[x] Usher
[ ] Security
[x] Social Media
[ ] Photography
[x] Food & Catering Organization
[ ] Other…

Additional Comments / Questions?
I am looking forward to hearing from you!

@choilmto hello, if you're still interested in volunteering, please email<EMAIL_ADDRESS>for next steps.


Expose / Copy path to user settings file

Issue Type: Feature Request
Related to https://github.com/Microsoft/vscode/issues/43082, which would be the ideal implementation. If that can't happen, at least provide a way to easily copy the path to the user settings file, so that I can manually replace it with a cloud shared one. For example, you could add a right click context menu on the user settings tab to copy the path, just like you have one for normal editor tabs.
VS Code version: Code 1.22.2 (3aeede733d9a3098f7b4bdc1f66b63b0f48c1ef9, 2018-04-12T16:38:45.278Z)
OS version: Windows_NT x64 10.0.16299

@cdmihai This is already supported

@sandy081 Oh, I see. I hadn't noticed the topmost tab, just the inner one (the one left to workspace settings). Sorry about that :)


Vanilla recipe book/advancement issues

There doesn't appear to be a way to naturally proc the acquisition of the Leather Backpack recipe for Minecraft's native recipe book feature. However, crafting a Leather Backpack does grant the Iron Backpack recipe.
Once acquired (through commands), all the backpack recipes act as if they are able to be crafted without a crafting table, but these "reduced cost" recipes don't actually function.
In addition, some of the advancements seem to be failing to trigger, such as "fill a leather backpack", or "move items with a hopper" (in fact, the hopper functionality doesn't seem to be working at all, or I'm just misunderstanding it).

Also, you mean hoppers aren't working at all?

"Fill a Leather Backpack" was checking wrong and "Dye a Leather Backpack" has been renamed to "Equip a Dyed Backpack". I cleaned up some hopper code in the latest commit but I couldn't recreate the hoppers not working.
Closing this issue and adding recipe book recipe's to my to-do since they're stable and I'll have to come back to them.

Also, you mean hoppers aren't working at all?

That's what I'm not sure about. This could be a "skill issue", but I can't seem to get hoppers to interact with backpacks in any way. What exactly is it that they are supposed to do?
By the way, thanks so much for this mod; it's exactly what I was after. Basing them on Bundles rather than Shulker Boxes is so much more interesting :)

Thank you!!  Kinda like using a data pack to add a recipe for diamonds to a dirt block. I'm glad you're liking my spin on the idea.
Hoppers just pull items out like if a minecart chest was on top of them. It could be a visual desync, check if the hopper has items in it because I'm aware of a bug that causes ghost items if many stacks are pulled out.
And I don't know if you're using the latest version (wait until 20.1-0.16-v2, critical bugs in 0.15) but Recipe's are working in the Recipe Book now. I didn't realize you have to gift the recipe's to players using advancements. I'm glad I checked my closed issues, hopefully this cleared things up.


Document how to update the zftp credentials using ZOWE CLI V2

 Documentation for updating Credentials over command line with ZOWE CLI V2 is not documented. My MVS password changed, but am not able to change the password for zftp profile using the zowe config set. ZOWE explorer extension in VSCODE profiles support for update credentials only for zosmf and uss. Can someone help, how should I update the zftp credentials using ZOWE CLI V2.

Hi @jeevakp  -- we document how to use the zowe config set and zowe config secure commands in Managing credential security.
Do you think this topic is sufficiently/appropriately documented? Or are there any changes you'd like to suggest to make this topic easier to understand/easier to find?

Closing as the zowe config set and zowe config secure commands have been documented in Managing credential security and have not received any additional feedback from @jeevakp


Metadata file for each template

Add a metadata file for each template that will allow the cli to display information such as description and more follow up commands after creation.

I've added suppor for an optional metadata file on each template.
This file should be named template.json  and contain something like the following:
{
  "name": "typescript-api",
  "description": "This template is used to create an express server with typescript, grahpql, typeorm, and postgres.",
  "commands": [
    {
      "name": "yarn",
      "description": "Install dependencies"
    },
    {
      "name": "yarn start:dev",
      "description": "Start the application in development mode"
    },
    {
      "name": "yarn build",
      "description": "Build the application"
    }
  ]
}

This metadata allows for a description to be shown were needed:

Also for basic getting started commands to be shown after a project is created:


[rds] Changing availabilityZones in a DBCluster causes ackrt to loop on failure

Describe the bug
Change the availabilityZones: in a DBCluster and the controlller will never make the change nor any others.
Steps to reproduce

Create a DBCluster
Change the availabilityZones
Observe the following in the logs for the controller: (abbreviated):

2022-01-20T17:05:45.309Z	INFO	ackrt	desired resource state has changed	{"account": "x", "role": "", "region": "us-west-2", "kind": "DBCluster", "namespace": "y", "name": "z", "is_adopted": false, "generation": 196, "diff": [{"Path":{"Parts":["Spec","AvailabilityZones"]},"A":["us-west-2a","us-west-2b","us-west-2d"],"B":["us-west-2c","us-west-2b","us-west-2a"]}]}
2022-01-20T17:05:45.462Z	INFO	ackrt	updated resource	{"account": "x", "role": "", "region": "us-west-2", "kind": "DBCluster", "namespace": "y", "name": "z", "is_adopted": false, "generation": 196}
2022-01-20T17:15:46.640Z	INFO	ackrt	desired resource state has changed	{"account": "x", "role": "", "region": "us-west-2", "kind": "DBCluster", "namespace": "y", "name": "z", "is_adopted": false, "generation": 198, "diff": [{"Path":{"Parts":["Spec","AvailabilityZones"]},"A":["us-west-2a","us-west-2b","us-west-2d"],"B":["us-west-2c","us-west-2b","us-west-2a"]}]}
2022-01-20T17:15:46.789Z	INFO	ackrt	updated resource	{"account": "x", "role": "", "region": "us-west-2", "kind": "DBCluster", "namespace": "y", "name": "z", "is_adopted": false, "generation": 198}
2022-01-20T17:25:47.760Z	INFO	ackrt	desired resource state has changed	{"account": "x", "role": "", "region": "us-west-2", "kind": "DBCluster", "namespace": "y", "name": "z", "is_adopted": false, "generation": 200, "diff": [{"Path":{"Parts":["Spec","AvailabilityZones"]},"A":["us-west-2a","us-west-2b","us-west-2d"],"B":["us-west-2c","us-west-2b","us-west-2a"]}]}
2022-01-20T17:25:47.878Z	INFO	ackrt	updated resource	{"account": "x", "role": "", "region": "us-west-2", "kind": "DBCluster", "namespace": "y", "name": "z", "is_adopted": false, "generation": 200}
...

Expected outcome
Throw an error if this isn't possible.
Environment

Kubernetes version 1.21
Using EKS (yes/no), if so version? yes 1.21
AWS service targeted (S3, RDS, etc.) RDS

It appears that AvailabilityZones is not a member of the ModifyDBClusterInput struct. Therefore any changes made to that part of the spec cannot be updated on the AWS resource. The resource would need to be deleted and re-created to support that operation, which I would probably assume is not the intended behaviour most users would want.
We need some logic here that adds a recoverable error condition when we detect an update to this field.

@jaypipes how do you feel about separate resources for unmodifiable (i.e., kubernetes immutable) and modifiable properties? I am sure this is something you've already considered. I'm most limited by what my IDE tells me about the properties, not the underlying mechanics.

/remove-lifecycle stale

@RedbackThomson is correct, the AvailabilityZone field is part of instance's field instead of cluster https://docs.aws.amazon.com/cli/latest/reference/rds/create-db-instance.html
Also when an instance is created , the AvailabilityZone is not able to be changed. If you're interested in changing it, you can recreate another instance in same cluster.
Regarding separate resources for unmodifiable and modifiable properties, it sounds like an improvement on general ack framework instead of rds controller one.
I'm planning to close this issue if there is no concern.

@brucegucode The code-generator supports the is_immutable property on any field in the generator config. This sets an ACK.Advisory condition if the user updates the field.

/close


Fix Kokoro GPU Testing

Hi @av8ramit, as of late last week we began getting failing Kokoro jobs with the error:
[03:23:09][ERROR] Config validation failed!
Example:
https://source.cloud.google.com/results/invocations/fe13d541-682a-4341-b512-c5be00905338/targets/tensorflow_addons%2Fubuntu%2Fgpu%2Fpy3%2Fcontinuous/log
I looked around and another repo had a similar issue a few weeks ago that they said was resolved on the kokoro side:
https://github.com/SymbiFlow/symbiflow-arch-defs/issues/2124
When time allows could you look around and see if something in the job configuration is out of date and causing these immediate job failures?

Hello @seanpmorgan I've taken a look and I believe I've fixed the root cause. The latest run is green.

Thanks so much @av8ramit !


split The New Architecture guide into few pages

This PR splits the New Architecture guide into few smaller pages which all are located in the "The New Architecture" section in the sidebar. I hope this will improve the overall readability of the guide for the users, since the split has been request few times.
The new pages titles can be improved for sure, I was focusing on trying to fit them in one line, but maybe it is an overoptimization, hope someone will look at that later. 😅
In this PR I have been focusing on the layout and formatting, no on the content itself, however there were small whitespace changes and syntax highlight correction, applied while I was moving the content.
To achieve the effect visible below I had to alter few lines of CSS, because non-linkable sidebar entries were missing a proper style (they were not used before) and we were unnecessary overwriting the sidebar sub-sections font size due to class name changes on the Docusuaurs side. Those changes will be pushed in separate PR against main branch.
Preview

I have resolved the conflicts and updated the branch with feat/new-arch and then synced it with main to get access to new "Architecture" top level grouping, to which I have moved the playbook entries.
Updated preview

I have resolved the conflicts and updated the branch with feat/new-arch and then synced it with main to get access to new "Architecture" top level grouping, to which I have moved the playbook entries.
Updated preview

I have reverted the main synce becouse it would result in issues while merging the feat/new-arch target branch into main. Let's sort the placement in separate PR, after the merge of this one and sync with main in main playbook draft. 😉

Makes total sense 👍 Let's merge this and rebase #2879 on top of main afterwards.


Warn when a computed field overwrites a reactive field

const state = proxyWithComputed({
   counter: 0
},{
  counter(snap) { // should be invalid
})

Could you elaborate on the example?

Yeah, this state definition is wrong because both the first object and the second have the same property key so this will silently fail when you try to use a snapshot.

Yeah, I noticed this limitation while developing it. I suppose we can check this in proxyWithComputed and ideally we should improve typing to avoid this.


Request to have azure cli of latest version in Homebrew formula

Description
Outline the issue here:
On webpage https://docs.microsoft.com/en-us/cli/azure/install-azure-cli, the azure-cli version on Homebrew formula is outdated. Can you update it on Homebrew?
Environment summary
Install Method: How did you install the CLI? (e.g. pip, interactive script, apt-get, Docker, MSI, nightly)
Answer here: we would like to install CLI of latest version through homebrew.
CLI Version: What version of the CLI and modules are installed? (Use az --version)
Answer here: 2.0
OS Version: What OS and version are you using?
Answer here: macOS sierra 10.12.6
Shell Type: What shell are you using? (e.g. bash, cmd.exe, Bash on Windows)
Answer here: bash

Closing as dupe of https://github.com/Azure/azure-cli/issues/643


[ip6] improve frame filtering

Some packets used by openthread internally were passed outside with
filters on. This fixes the issue with coap frames being passed
outside when OpenThread CoAP API is used.
Fixes "ICMPv6 Destination Unreachable (Port unreachable)" in zephyr.
Signed-off-by: Marek Porwisz<EMAIL_ADDRESS>

HAHA, That's a Draft PR :) I didn't expect anyone to look into it. I'm still looking for a proper solution to our issue.
I had problems running tests locally so I created draft PR to run tests on server.
The issue comes from Zephyr and NCS:
The otIp6SetReceiveCallback is used to pass all the frames to Zephyr's IP stack. The filtering filters Thread control frames nicely, but it does not filter anything else.
When OpenThread CoAP API is used, a socket is allocated in OpenThread, but the frames are passed to Zephyr as well and since the socket is not open on zephyr's side we get "ICMPv6 Destination Unreachable (Port unreachable)".
I was thinking about calling IsPortInUse from zephyr after frame is received, but I the place I could call this zephyr did not yet parse the packet, and OT does not pass the protocol and port to the callback function.
Now I am trying the approach with additional filter option, so the API will allow to enable filtering only control msgs, or everything that is used by OpenThread. I'm still not sure this will fix all the problems but at least should not break existing functionalities.

closing for now


zmq install failed

Rafals-MacBook:myproject rav$ node -v
v0.6.2

Rafals-MacBook:myproject rav$ npm -v
1.0.106

Rafals-MacBook:myproject rav$ brew list zeromq
/usr/local/Cellar/zeromq/2.1.10/include/ (3 files)
/usr/local/Cellar/zeromq/2.1.10/lib/libzmq.1.dylib
/usr/local/Cellar/zeromq/2.1.10/lib/pkgconfig/libzmq.pc
/usr/local/Cellar/zeromq/2.1.10/lib/ (2 other files)
/usr/local/Cellar/zeromq/2.1.10/share/man/ (30 files)

Rafals-MacBook:myproject rav$ npm install zmq

><EMAIL_ADDRESS>preinstall /Users/rav/Documents/myproject/node_modules/zmq
> node-waf clean || true; node-waf configure build

Nothing to clean (project not configured)
Setting srcdir to                        : /Users/rav/Documents/myproject/node_modules/zmq
Setting blddir to                        : /Users/rav/Documents/myproject/node_modules/zmq/build
Checking for program g++ or c++          : /usr/bin/g++
Checking for program cpp                 : /usr/bin/cpp
Checking for program ar                  : /usr/bin/ar
Checking for program ranlib              : /usr/bin/ranlib
Checking for g++                         : ok
Checking for node path                   : not found
Checking for node prefix                 : ok /usr/local/Cellar/node/0.6.2
Checking for pkg-config version >= 0.0.0 : pkg-config was not found
/Users/rav/Documents/myproject/node_modules/zmq/wscript:14: error: the configuration failed (see '/Users/rav/Documents/myproject/node_modules/zmq/build/config.log')
npm ERR! error installing<EMAIL_ADDRESS>Error<EMAIL_ADDRESS>preinstall: `node-waf clean || true; node-waf configure build`
npm ERR! error installing<EMAIL_ADDRESS>`sh "-c" "node-waf clean || true; node-waf configure build"` failed with 1
npm ERR! error installing<EMAIL_ADDRESS>   at ChildProcess.<anonymous> (/usr/local/lib/node_modules/npm/lib/utils/exec.js:49:20)
npm ERR! error installing<EMAIL_ADDRESS>   at ChildProcess.emit (events.js:70:17)
npm ERR! error installing<EMAIL_ADDRESS>   at maybeExit (child_process.js:359:16)
npm ERR! error installing<EMAIL_ADDRESS>   at Process.onexit (child_process.js:395:5)
npm ERR<EMAIL_ADDRESS>preinstall: `node-waf clean || true; node-waf configure build`
npm ERR! `sh "-c" "node-waf clean || true; node-waf configure build"` failed with 1
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>preinstall script.
npm ERR! This is most likely a problem with the zmq package,
npm ERR! not with npm itself.
npm ERR! Tell the author that this fails on your system:
npm ERR!     node-waf clean || true; node-waf configure build
npm ERR! You can get their info via:
npm ERR!     npm owner ls zmq
npm ERR! There is likely additional logging output above.
npm ERR!
npm ERR! System Darwin 11.2.0
npm ERR! command "node" "/usr/local/bin/npm" "install" "zmq"
npm ERR! cwd /Users/rav/Documents/myproject
npm ERR! node -v v0.6.2
npm ERR! npm -v 1.0.106
npm ERR! code ELIFECYCLE
npm ERR!
npm ERR! Additional logging details can be found in:
npm ERR!     /Users/rav/Documents/myproject/npm-debug.log
npm not ok

I've deleted line with ev.h and now works

where did you remove the line?

binding.cc
https://github.com/JustinTulloss/zeromq.node/blob/master/binding.cc#L31

This problem was resolved in versions 1.0.4 and 2.0.0

I have this problem:
thota# npm install zmq

<EMAIL_ADDRESS>preinstall /user1/sites/nodejs/node_modules/zmq
node-waf clean || true; node-waf configure build

Nothing to clean (project not configured)
Setting srcdir to                        : /user1/sites/nodejs/node_modules/zmq
Setting blddir to                        : /user1/sites/nodejs/node_modules/zmq/build
Checking for program g++ or c++          : /usr/bin/g++
Checking for program cpp                 : /usr/bin/cpp
Checking for program ar                  : /usr/bin/ar
Checking for program ranlib              : /usr/bin/ranlib
Checking for g++                         : ok
Checking for node path                   : not found
Checking for node prefix                 : ok /usr/local/node-v0.6.6
Checking for pkg-config version >= 0.0.0 : yes
Checking for libzmq >= 2.1.0             : Package libzmq was not found
/user1/sites/nodejs/node_modules/zmq/wscript:15: error: the configuration failed (see '/user1/sites/nodejs/node_modules/zmq/build/config.log')
npm ERR! error installing<EMAIL_ADDRESS>Error<EMAIL_ADDRESS>preinstall: node-waf clean || true; node-waf configure build
npm ERR! error installing<EMAIL_ADDRESS>sh "-c" "node-waf clean || true; node-waf configure build" failed with 1
npm ERR! error installing<EMAIL_ADDRESS>   at ChildProcess. (/usr/local/node-v0.6.6/lib/node_modules/npm/lib/utils/exec.js:49:20)
npm ERR! error installing<EMAIL_ADDRESS>   at ChildProcess.emit (events.js:70:17)
npm ERR! error installing<EMAIL_ADDRESS>   at maybeExit (child_process.js:359:16)
npm ERR! error installing<EMAIL_ADDRESS>   at Process.onexit (child_process.js:395:5)
npm ERR<EMAIL_ADDRESS>preinstall: node-waf clean || true; node-waf configure build
npm ERR! sh "-c" "node-waf clean || true; node-waf configure build" failed with 1
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>preinstall script.
npm ERR! This is most likely a problem with the zmq package,
npm ERR! not with npm itself.
npm ERR! Tell the author that this fails on your system:
npm ERR!     node-waf clean || true; node-waf configure build
npm ERR! You can get their info via:
npm ERR!     npm owner ls zmq
npm ERR! There is likely additional logging output above.
npm ERR!
npm ERR! System Linux 2.6.18-274.12.1.el5
npm ERR! command "node" "/usr/local/node/bin/npm" "install" "zmq"
npm ERR! cwd /user1/sites/nodejs
npm ERR! node -v v0.6.6
npm ERR! npm -v 1.0.106
npm ERR! code ELIFECYCLE
npm ERR!
npm ERR! Additional logging details can be found in:
npm ERR!     /user1/sites/nodejs/npm-debug.log
npm not ok
I have tried this with both v2.1.x and 3.1.x. Here is part of: ldconfig -v:
/usr/local/zeromq/lib:
libzmq.so.3 -> libzmq.so.3.0.0

Updating my above query for the benefit of others.
By setting with the location of installed libzero to PKG_CONFIG_PATH env variable I was able to continue with my install:
export PKG_CONFIG_PATH=/usr/local/zeromq/lib/pkgconfig/
It didn't work with 3.1.0, but installation did succeed with 2.1.11 version of zeromq.

@gametbt
If you want to use with 3.1.0 you can use this: https://github.com/shripadk/zeromq.node
Will be pushing changes (for 3.1.0) to this repo in a few days :)


Header Content-Type is missing

Here is the example with the application/octet-stream content type of post body:
/pets/{petId}:
    post:
      tags:
        - pets
      parameters:
        - name: petId
          in: path
          required: true
          description: The id of the pet
          schema:
            type: string
      requestBody:
        description: pets File
        content:
          application/octet-stream:
            schema:
              type: string
              format: binary
      responses:
        '200':
          description: File has been uploaded

Generated method:
export const postVversionPetsPetId = (
    petId: string,
    postVversionPetsPetIdBody: Blob,
    version= 1,
 ) => {
      return customInstance<void>(
      {url: `/v${version}/pets/${petId}`, method: 'post',
      data: postVversionPetsPetIdBody
    },
      );
    }

Unexpectedly generated method didn't provide this part of the request headers:
headers: {
  'Content-Type': 'application/octet-stream'
}

Can confirm, it works like a charm!


grafana-plugin image not customisable

Hi,
I'm behind an artifactory proxy, so I have to change grafana-plugins image to remove "quay.io" part, but it's hardcoded in template,
quay.io/integreatly/grafana_plugins_init:{{ .PluginsInitContainerImageTag }}'
Thanks in advance for your help
Ludo

Fixed in https://github.com/integr8ly/grafana-operator/pull/15 and https://github.com/integr8ly/grafana-operator/pull/16
@neoludo a new release is available wich includes your fix and another change to make the tag also configurable. The image for this release is available here.

Thanks Peter
On Mon, Jun 17, 2019 at 10:46 AM Peter Braun<EMAIL_ADDRESS>wrote:

Fixed in #15 https://github.com/integr8ly/grafana-operator/pull/15 and
#16 https://github.com/integr8ly/grafana-operator/pull/16
@neoludo https://github.com/neoludo a new release
https://github.com/integr8ly/grafana-operator/releases/tag/v1.1.0 is
available wich includes your fix and another change to make the tag also
configurable. The image for this release is available here
https://quay.io/repository/integreatly/grafana-operator?tab=tags.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/integr8ly/grafana-operator/issues/14?email_source=notifications&email_token=AAD76MM4JU47SY5PMMTXS53P25FMRA5CNFSM4HXXNLA2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGODX2PBVI#issuecomment-502591701,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAD76MLTQRFGKHLXGBCLLSLP25FMRANCNFSM4HXXNLAQ
.


Add an option for user-defined key presses

This adds a keyword argument to provide a function to respond to custom key presses.
This is currently used in Eyeball.jl (using a vendored version).
I'm not sure if it's best to use keypress::Any in the TreeMenu struct.

Codecov Report

Merging #10 (4c5c191) into master (1c41f86) will not change coverage.
The diff coverage is 100.00%.

@@            Coverage Diff            @@
##            master       #10   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files            3         3
  Lines          156       150    -6
=========================================
- Hits           156       150    -6

Impacted Files
Coverage Δ

src/treemenu.jl
100.00% <100.00%> (ø)

src/foldingtree.jl
100.00% <0.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1c41f86...4c5c191. Read the comment docs.

Thanks, @tshort!


How to handle Nuget packages referenced from repositories other than Nuget.org

We deploying our sites we are make use of some NuGet packages that are stored on a different repository than the one at Nuget.org. The Packages from the Nuget.org are installed without any issue but when we reach the NuGets from the different repository we are getting the following error on the " Running deployment command... " action:
Command: "C:\inetpub\apps\helloidentity\site\deployments\tools\deploy.cmd"
Handling .NET Web Application deployment.
Unable to find version '3.0.20820.0' of package 'AjaxControlToolkit'.
Unable to find version '<IP_ADDRESS>' of package 'DirectShowLib-2005'.
Unable to find version '<IP_ADDRESS>' of package 'linqtotwitterNET40'.
Unable to find version '<IP_ADDRESS>' of package 'Microsoft.Http'.
Unable to find version '15.0.4569.1000' of package 'Microsoft.SharePoint.Client'.
Unable to find version '6.6.6' of package 'MySql.Data'.
Unable to find version '<IP_ADDRESS>' of package 'payflow_dotNET'.
Unable to find version '<IP_ADDRESS>' of package 'Sitefinity.RazorEngine'.
Failed exitCode=1, command=nuget restore "C:\inetpub\apps\helloidentity\site\repository\src\HelloIdentityWebSite\HelloIdentityWebSite.sln"
Unable to find version '<IP_ADDRESS>' of package 'Sitefinity.RedDog.Search'.
An error has occurred during web site deployment.
We have enabled the package restore on the solution and the repository is defined as a package source on nuget.target file which is under source control under the .nyget folder at the solution level. When building on TFS we are not getting any error and the packages gets restored properly using the repository defined on the NuGet.target.
I tried to add a NuGet.Config on the same folder as the NuGet.exe which is used by kudu "C:\inetpub\Kudu.Services.Web\bin\Scripts\Nuget.Config" with the following:
<?xml version="1.0" encoding="utf-8"?>
<configuration>
  <packageSources>
    <add key="Nuget" value="https://www.nuget.org/api/v2/" />
    <add key="SiteFinity" value="http://http://nuget.sitefinity.com/nuget/" />
  </packageSources>
</configuration>

But it still cannot find the Nugets... Any idea how I can resolve this?

Are you sure the SiteFinity source is specified correctly in your NuGet.config? It has two http:// in the url

Indeed you are right. Unfortunatlly this does not resolve might issue...The typo was comming from my trial to add a NuGet.config file on the scripts folder. Apparently this config file is not picked up :(
I checked my Nuget.target file on the solution and it does contains the right values...

I looked at the deployment script "deploy.cmd".
It calls the following command:
:: 1. Restore NuGet packages
IF /I "src\HelloIdentityWebSite\HelloIdentityWebSite.sln" NEQ "" (
call :ExecuteCmd nuget restore "%DEPLOYMENT_SOURCE%\src\HelloIdentityWebSite\HelloIdentityWebSite.sln"
IF !ERRORLEVEL! NEQ 0 goto error
)
I tried to run the nuget restore command manualy from the repository folder:
C:\inetpub\apps\helloidentity\site\repository [master]> nuget restore .\src\HelloIdentityWebSite\HelloIdentityWebSite.sl
n
Installing 'MySql.Data 6.6.6'.
Installing 'linqtotwitterNET40 <IP_ADDRESS>'.
Installing 'Microsoft.Http <IP_ADDRESS>'.
Installing 'DirectShowLib-2005 <IP_ADDRESS>'.
Installing 'payflow_dotNET <IP_ADDRESS>'.
Installing 'Sitefinity.RazorEngine <IP_ADDRESS>'.
Installing 'Microsoft.SharePoint.Client 15.0.4569.1000'.
Installing 'AjaxControlToolkit 3.0.20820.0'.
Successfully installed 'Microsoft.Http <IP_ADDRESS>'.
Successfully installed 'payflow_dotNET <IP_ADDRESS>'.
Successfully installed 'DirectShowLib-2005 <IP_ADDRESS>'.
Successfully installed 'linqtotwitterNET40 <IP_ADDRESS>'.
Successfully installed 'Microsoft.SharePoint.Client 15.0.4569.1000'.
Successfully installed 'AjaxControlToolkit 3.0.20820.0'.
Successfully installed 'Sitefinity.RazorEngine <IP_ADDRESS>'.
Successfully installed 'MySql.Data 6.6.6'.
Installing 'Sitefinity.Windows.Azure <IP_ADDRESS>'.
Installing 'Sitefinity.RedDog.Search <IP_ADDRESS>'.
Successfully installed 'Sitefinity.RedDog.Search <IP_ADDRESS>'.
Installing 'System.Windows 5.0.61118.0'.
Installing 'Telerik.Sitefinity.Analytics 8.0.5701.0'.
Installing 'Telerik.Sitefinity.Audit.Elasticsearch 8.0.5701.0'.
Installing 'Telerik.Sitefinity.All 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.All 8.0.5701.0'.
Installing 'Telerik.Sitefinity.AuditTrail 8.0.5701.0'.
Installing 'Telerik.Sitefinity.Connectivity 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.Audit.Elasticsearch 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.AuditTrail 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.Connectivity 8.0.5701.0'.
Successfully installed 'System.Windows 5.0.61118.0'.
Successfully installed 'Sitefinity.Windows.Azure <IP_ADDRESS>'.
Successfully installed 'Telerik.Sitefinity.Analytics 8.0.5701.0'.
Installing 'Telerik.Sitefinity.Content 8.0.5701.0'.
Installing 'Telerik.Sitefinity.Core 8.0.5701.0'.
Installing 'Telerik.Sitefinity.Dashboard 8.0.5701.0'.
Installing 'Telerik.Sitefinity.DAM 8.0.5701.0'.
Installing 'Telerik.Sitefinity.DigitalExperienceCloudConnector 8.0.5701.0'.
Installing 'Telerik.Sitefinity.Diagnostics 8.0.5701.0'.
Installing 'Telerik.Sitefinity.DropboxLibraries 8.0.5701.0'.
Installing 'Telerik.Sitefinity.Everlive 8.0.5701.0'.
Installing 'Telerik.Sitefinity.EverliveConnector 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.EverliveConnector 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.DigitalExperienceCloudConnector 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.Dashboard 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.DropboxLibraries 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.Diagnostics 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.DAM 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.Everlive 8.0.5701.0'.
Installing 'Telerik.Sitefinity.Feather <IP_ADDRESS>'.
Installing 'Telerik.Sitefinity.Feather.Core <IP_ADDRESS>'.
Installing 'Telerik.Sitefinity.MarketoConnector 8.0.5701.0'.
Installing 'Telerik.Sitefinity.Octopus 2<IP_ADDRESS>'.
Installing 'Telerik.Sitefinity.Migration 8.0.5701.0'.
Installing 'Telerik.Sitefinity.Mvc 8.0.5701.0'.
Installing 'Telerik.Sitefinity.MobileAppBuilder 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.MarketoConnector 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.Mvc 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.MobileAppBuilder 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.Migration 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.Feather.Core <IP_ADDRESS>'.
Successfully installed 'Telerik.Sitefinity.Content 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.Octopus 2<IP_ADDRESS>'.
Installing 'Telerik.Sitefinity.PrecompiledPages.Backend 8.0.5701.0'.
Installing 'Telerik.Sitefinity.OpenAccess 8.0.5701.0'.
Installing 'Telerik.Sitefinity.Reporting.Controls <IP_ADDRESS>2'.
Installing 'Telerik.Sitefinity.PrecompiledTemplates 8.0.5701.0'.
Installing 'Telerik.Sitefinity.RecycleBin 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.PrecompiledPages.Backend 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.OpenAccess 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.RecycleBin 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.Reporting.Controls <IP_ADDRESS>2'.
Installing 'Telerik.Sitefinity.SalesForceConnector 8.0.5701.0'.
Installing 'Telerik.Sitefinity.ServicesImpl 8.0.5701.0'.
Installing 'Telerik.Sitefinity.SharepointConnector 8.0.5701.0'.
Installing 'Telerik.Sitefinity.SiteSync 8.0.5701.0'.
Installing 'Telerik.Sitefinity.SitemapGenerator 8.0.5701.0'.
Installing 'Telerik.Sitefinity.TfisClient 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.SitemapGenerator 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.SalesForceConnector 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.SharepointConnector 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.SiteSync 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.TfisClient 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.PrecompiledTemplates 8.0.5701.0'.
Installing 'Telerik.Web.UI 2<IP_ADDRESS>'.
Installing 'Telerik.Sitefinity.Windows.Controls 2013.1.415.40'.
Installing 'Telerik.Sitefinity.Thunder 8.0.5701.0'.
Installing 'Telerik.Sitefinity.Twitterizer 2.4.1'.
Successfully installed 'Telerik.Sitefinity.ServicesImpl 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.Twitterizer 2.4.1'.
Successfully installed 'Telerik.Sitefinity.Thunder 8.0.5701.0'.
Successfully installed 'Telerik.Sitefinity.Windows.Controls 2013.1.415.40'.
Successfully installed 'Telerik.Sitefinity.Feather <IP_ADDRESS>'.
Successfully installed 'Telerik.Sitefinity.Core 8.0.5701.0'.
Successfully installed 'Telerik.Web.UI 2<IP_ADDRESS>'.
All packages listed in packages.config are already installed.
C:\inetpub\apps\helloidentity\site\repository [master]>
There it restore the package without any issue.
Could it be that the LocalSystem which is used to run the deploy.cmd from the application pool cannot access the site repository?....

If you click Retry for the deployment, does it fail consistently? That runs in the same context as when using the Kudu console, so it should work.

If I run the nuget restore  manually from the repository folder it downloads the package into the packages folder and then running the Deploy again proceed (but then it fails again for another reason that I'm investigating I might create another issue for this one. :))
If I run a Redeploy(clean) then if fails but it make sense as It removes the nuget from the packages folder and try to redownload them.. I still have no idea why it is not downloading the packages from the SiteFinity Repository :(

Could you share a repro repository so we can take a closer look? And if you create a new test site and deploy there, does it happen consistently?

Thanks for the help. I have compiled a dummy repo that reproduce the problem.
It is a dummy ASP.NET mvc application. I could deploy it without any issue when all packages came from the Nuget.org repo. I then have added the package AjaxControlToolkit fromt the Telerik Sifinity Repo and then I get the error the package cannot be restored...
Command: "C:\inetpub\apps\mvcapplication\site\deployments\tools\deploy.cmd"
Handling .NET Web Application deployment.
Unable to find version '3.0.20820.0' of package 'AjaxControlToolkit'.
Failed exitCode=1, command=nuget restore "C:\inetpub\apps\mvcapplication\site\repository\src\MVCApplicationTest\MVCApplicationTest.sln"
An error has occurred during web site deployment.
The repo i'm trying to deploy can be found on github at:
https://github.com/AlexandreRoba/MVCApplicationTest
thanks for any help you can provide me on this :)

This version indeed doesn't exist on http://www.nuget.org/packages/AjaxControlToolkit/. It doesn't seem like you're specifying an alternate feed anywhere, so the error is expected. What am I missing here?
BTW, you should not be enabling NuGet package restore. That was the old way of doing it. See http://blog.davidebbo.com/2014/01/the-right-way-to-restore-nuget-packages.html. You should not  have nuget.exe in your repo at all.

I'm specifying the alternate place of the repository on the nuget.targets file which is created by the "Enable Nuget restore". You can find it there: https://github.com/AlexandreRoba/MVCApplicationTest/blob/master/src/MVCApplicationTest/.nuget/NuGet.targets
I'll check the "new way" of restoring packages and I'll try that. I'll keep you posted.

Custom feeds are set using nuget.config, which you can have next to your sln file. See here

I made the correction. I check Xavier Decoster Blog that raised also couple of issues with the "old" way of enabling package restore aka MSBuild-Integrated Package Restore.
In my case I was not able to enable package restore this way with kudu. This approach is still supported by NuGet and I totally understand that an open source project as other things to do than supporting a becoming deprecated functionality of NuGet. :)
I have enabled the Automatic package restore since and it works like a charm.
Thanks for your support.


Support for configuring the zoom direction of the animation.

The default implementation of the JBKenBurnsView always zooms in on images. This adds support for allowing the user to choose the direction of zoom: in, out, or a random direction.

Look like a nice feature. Thanks!


Deployment/Update: standardize double quote marks

Description:
As reported in issue ticket #6241 (Curly quotes in PowerShell script prevent it from working), this page contains curly double quote marks in its PowerShell scripts and cmdlets. These incorrectly inserted characters within code snippets (or maybe they were incorrectly re-coded some time ago) prevent the code snippets from being read correctly by PowerShell. This PR aims to resolve this issue.
Thanks to @hsehestedt for reporting this issue.
Changes proposed:

Replace incorrect curly quote marks with straight ones
Add "PowerShell" as MarkDown syntax highlight identifiers
Remove redundant end-of-line blanks throughout the document

Ticket closure or reference:
Closes #6241

#sign-off

(Ref. PR #6275 for the same file, with only the curly quotes changed.)

@illfated I'm going to go with #6275 b/c that PR is from the SME for the topic--he specifically did not want the PowerShell identifier for the code block b/c it was rendering strangely (we should probably file a bug on that). That's why we went with the plain generic rendering.

OK, fair enough.


GH-42030: [Java] Update Unit Tests for Adapter Module

Rationale for this change
Update package from JUnit 4(org.junit) to JUnit 5(org.junit.jupiter).

What changes are included in this PR?

avro and jdbc module

[x] Replacing org.junit with org.junit.jupiter.api.
[x] Updating Assertions.assertXXX to assertXXX using static imports.
[x] Updating annotations such as @Before, @After.

@Before -> @BeforeEach
@After -> @AfterEach
@Test -> @Test with org.junit.jupiter
@ClassRule -> @TempDir and @BeforeAll

[x] Updating Parameterized test
[x] Doing self review for avro
[ ] Dealing with java.io.IOException: Failed to delete temp directory on Windows with JDK 11
[x] Exploring a more effective structure for ParameterizedTest in JDBC tests.
[x] Doing self review for jdbc

orc module

[x] Reviewing the build method
[x] Updating annotations such as @BeforeAll, @Rule, @TemporaryFolder
[x] Doing self review

Are these changes tested?
Yes, existing tests have passed.

Are there any user-facing changes?
No.

GitHub Issue: #42030

I currently use explicit calls to initializeDatabase in each test method. However, I believe there is a more efficient structure for this process.
Reason

In JUnit 4, the method calling sequence is: constructor -> @Before -> @ParameterizedTest.

In JUnit 5, the constructor is not used for @ParameterizedTest.

Ummm....
There is a JUnit 5 bug on Windows (Server 2022) with JDK 11, specifically in the CI used by Arrow.

https://github.com/junit-team/junit5/issues/2811
https://github.com/apache/arrow/actions/runs/9437309980/job/25993017637?pr=42038#step:5:2647

Should we consider a rollback because of this, or is there another solution we could explore?

Ummm....
There is a JUnit 5 bug on Windows (Server 2022) with JDK 11, specifically in the CI used by Arrow.
* [@TempDir directory cannot be deleted on Windows with Java 11 junit-team/junit5#2811](https://github.com/junit-team/junit5/issues/2811)

* https://github.com/apache/arrow/actions/runs/9437309980/job/25993017637?pr=42038#step:5:2647

Should we consider a rollback because of this, or is there another solution we could explore?
error message
Error:  Tests run: 5, Failures: 0, Errors: 4, Skipped: 0, Time elapsed: 3.553 s <<< FAILURE! -- in org.apache.arrow.adapter.avro.AvroToArrowIteratorTest
[INFO] --- maven-surefire-plugin:3.2.5:test (default-test) @ arrow-jdbc ---
Error:  org.apache.arrow.adapter.avro.AvroToArrowIteratorTest.testArrayType -- Time elapsed: 0.125 s <<< ERROR!
java.io.IOException: Failed to delete temp directory D:\a\arrow\arrow\java\adapter\avro\target\junit4444716940079148427. The following paths could not be deleted (see suppressed exceptions for details): <root>, test.avro
	at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
	at java.base/java.util.ArrayList.forEach(ArrayList.java:1541)
	at java.base/java.util.stream.SortedOps$RefSortingSink.end(SortedOps.java:395)
	at java.base/java.util.stream.Sink$ChainedReference.end(Sink.java:258)
	at java.base/java.util.stream.Sink$ChainedReference.end(Sink.java:258)
	at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:485)
	at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
	at java.base/java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:150)
	at java.base/java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:173)
	at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
	at java.base/java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:497)
	at java.base/java.util.ArrayList.forEach(ArrayList.java:1541)
	at java.base/java.util.ArrayList.forEach(ArrayList.java:1541)
	Suppressed: java.nio.file.DirectoryNotEmptyException: D:\a\arrow\arrow\java\adapter\avro\target\junit4444716940079148427
		at java.base/sun.nio.fs.WindowsFileSystemProvider.implDelete(WindowsFileSystemProvider.java:271)
		at java.base/sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:105)
		at java.base/java.nio.file.Files.delete(Files.java:1142)
		at java.base/java.nio.file.Files.walkFileTree(Files.java:2743)
		at java.base/java.nio.file.Files.walkFileTree(Files.java:2797)
		... 13 more
	Suppressed: java.nio.file.FileSystemException: D:\a\arrow\arrow\java\adapter\avro\target\junit4444716940079148427\test.avro: The process cannot access the file because it is being used by another process.

		at java.base/sun.nio.fs.WindowsException.translateToIOException(WindowsException.java:92)
		at java.base/sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:103)
		at java.base/sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:108)
		at java.base/sun.nio.fs.WindowsFileSystemProvider.implDelete(WindowsFileSystemProvider.java:274)
		at java.base/sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:105)
		at java.base/java.nio.file.Files.delete(Files.java:1142)
		at java.base/java.nio.file.Files.walkFileTree(Files.java:2725)
		at java.base/java.nio.file.Files.walkFileTree(Files.java:2797)
		... 13 more
		Suppressed: java.nio.file.FileSystemException: D:\a\arrow\arrow\java\adapter\avro\target\junit4444716940079148427\test.avro: The process cannot access the file because it is being used by another process.

			... 21 more

UPDATE:
I tried two kinds of approaches
Using try-with-resources Statements for FileOutputStream and FileInputStream
try (FileOutputStream outStream = new FileOutputStream(dataFile);
     FileInputStream inStream = new FileInputStream(dataFile)) {
    BinaryEncoder encoder = new EncoderFactory().directBinaryEncoder(outStream, null);
    DatumWriter<Object> writer = new GenericDatumWriter<>(schema);
    for (Object value : data) {
        writer.write(value, encoder);
    }
    outStream.flush();

    BinaryDecoder decoder = new DecoderFactory().directBinaryDecoder(inStream, null);
    return AvroToArrow.avroToArrow(schema, decoder, config);
}

Separating FileOutputStream and FileInputStream Usage to Avoid Concurrent Access
  protected VectorSchemaRoot writeAndRead(Schema schema, List data) throws Exception {
    File dataFile = new File(TMP, "test.avro");

    try (FileOutputStream out = new FileOutputStream(dataFile)) {
      BinaryEncoder encoder = new EncoderFactory().directBinaryEncoder(out, null);
      DatumWriter<Object> writer = new GenericDatumWriter<>(schema);
      for (Object value : data) {
        writer.write(value, encoder);
      }
      out.flush();
    }

    try (FileInputStream in = new FileInputStream(dataFile)) {
      BinaryDecoder decoder = new DecoderFactory().directBinaryDecoder(in, null);
      return AvroToArrow.avroToArrow(schema, decoder, config);
    }
  }

@llama90 thanks for taking a very thorough assessment on this. I think the issue still persists. Furthermore looking into the JUNIT5 bug report, it seems that there isn't a solid fix yet. So my suggestion would be to fix it once that's resolved.
Although, we can create two sub-issues for this ticket, one for functional conversion (orc) and other for non-functional bits.
So that we can track the failing one later. But I have doubts about that approach.
cc @lidavidm Appreciate your feedback.

@llama90 the CI failures are due to spotless issue. Could you please try mvn spotless:apply' before building?  We will integrate pre-commit` sooner, so that this won't be an issue.

@llama90 the CI failures are due to spotless issue. Could you please try mvn spotless:apply before building? We will integrate pre-commit sooner, so that this won't be an issue.

Yes, I tried to check (mvn spotless:apply) before PR, but sometimes I missed it 🥲
I can't test the environment for Windows locally, I am repeatedly testing it through CI.

Yes, I tried to check (mvn spotless:apply) before PR, but sometimes I missed it 🥲

Yeah that happens, and after pre-commit that will be warned before committing.

I can't test the environment for Windows locally, I am repeatedly testing it through CI.

I understand. Thanks.

@vibhatha @lidavidm lol. Finally, it looks I've resolved the problem!
I would appreciate it if you could review this when you have free time.

comment

Thanks for figuring it out! So basically, we weren't properly closing the file in all cases and that stopped Windows from deleting the temp files?

File deletion operations differ across operating systems. Specifically, Windows only marks a file for deletion on close. Therefore, it's important to use explicit resource management, such as try-with-resources, to ensure proper release of resources.

reference: https://github.com/junit-team/junit5/issues/2811#issuecomment-1703476137


Filling holes in image IDs

While building some prototypes with an array of images, I found that some some IDs seem to return a 404 with Image does not exist. As example, this code…
new Array(20).fill().forEach((_, i) => {
  const img = new Image()
  img.width = 100
  img.height = 100
  img.src = `https://picsum.photos/id/${i + 740}/100/100`
  document.body.appendChild(img)
})

…results in this set of mostly broken images.

To check which ones are missing/broken, I created this tester page and found that the following IDs resulted in errors:

86, 97, 105, 138, 148, 150, 205, 207, 224, 226, 245, 246, 262, 285, 286, 298, 303, 332, 333, 346, 359, 394, 414, 422, 438, 462, 463, 470, 489, 540, 561, 578, 587, 589, 592, 595, 597, 601, 624, 632, 636, 644, 647, 673, 697, 706, 707, 708, 709, 710, 711, 712, 713, 714, 720, 725, 734, 745, 746, 747, 748, 750, 749, 751, 753, 752, 754, 759, 761, 762, 763, 771, 792, 801, 812, 843, 850, 854, 895, 897, 899, 917, 920, 934, 956, 963, 968, 1007, 1017

I'm not quite sure what causes these images to error, but I was wondering if it'd be possible to either squash the list down so all of the IDs are sequential or (in case people are relying on specific IDs) replace them with other working images? It would simplify prototypes that need to show a range of images and eliminate needing special code to check if the images error out and need to use a different ID.

Hi,
Thank you for filing an issue! The IDs of existing images can't be changed for backwards compatibility reasons, and we currently have no plans to fill the gaps, you shouldn't be relying on them being sequential.
If you want a static set of images rather then random from just passing the dimensions, you can paginate use the list endpoint to get all valid IDs, or use the /seed endpoint.
Duplicate of #102, #83


README should include examples of CLI invocation of the tools

Ideally, there is an example that, after having followed the setup described in the README, the user can copy and paste onto their command prompt and execute.


Unable to process large javascript files

I had to run through a couple of hurdles to try out your tool.  First, the application I wanted to test is only available via localhost and I couldn't run it using HTTPS.
So, I git cloned your code and hacked the client to allow me to enter an HTTP address and then ran the client/server locally using the instructions in the README.md.
The next hurdle I ran into was a size limitation, which appears to cap out at 2MB.  My JavaScript file is about 6MB for the largest file, plus a couple of other smaller files.
I tried modifying the server code, but I wasn't able to figure out how to run that server code locally.  I tried changing the both of the "Refusing" messages within handlers.js and the MAX_SIZE variable, but doing that seemed to have no effect.   I suspect the server files first need to be deployed to firebase and of course I can't do that.
Is there anyway to run server modifications locally?  (I'm not a firebase expert).  Alternatively, would you be able to increase the MAX_SIZE limitation and deploy that?   I'd understand if that's a non-starter if that costs you $$$.  Just trying to figure out how to run this because I'm very curious about a large app that I've developed.

Is this the error you are seeing:

Refusing to process more than 2MB of JavaScript.

Note that you need to re-run npm run build and firebase emulators:start after doing any code changes. I think I was able to change the MAX_SIZE variable inside handlers.js


[Feature] Add a speed limit in config?

It would be nice, if we can have add download/upload speed limits in config!

Since speed-limits aren't supported by the webtorrent library i can't add it. If it's added to the webtorrent, then I can add the options to this app as well.
FYI webtorrent has multiple open issues/pull requests regarding speed limits.

webtorrent now supports this, I have added options for this in version 1.4.0


Allow excluding packages from verification with --exclude

Description of changes:
This PR adds a --exclude option to Kani and allows excluding packages from verification (requested in #2375). It also adds validation for the packages passed to --package and --exclude so we print a user-friendly error with all unknown packages, instead of using expect as we were doing for arguments to --package.
Resolved issues:
Resolves #2375
Call-outs:
This --exclude option doesn't keep parity with cargo's --exclude because it doesn't require --workspace (but it's implied anyway). We could easily change it so --workspace is required, but I'd like to hear your thoughts.

Testing:

How is this change tested? Existing tests + 4 new ones.

Is this a refactor change? No.

Checklist

[x] Each commit message has a non-empty body, explaining why the change was made
[x] Methods or procedures are documented
[x] Regression or unit tests are included, or existing tests cover the modified code
[x] My PR is restricted to a single feature or bugfix

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 and MIT licenses.

I'd prefer if we make --workspace required to keep the same interface as cargo build/test.

Thanks, it's required now.


space between line numbers and code

On mine there's no space:

Should there be spacing between the line numbers and the code? Or is this still TODO?

Just curious, would the original Prism line-numbers plugin work? Or does that present issues when trying to update the highlight on code change?

Just curious, would the original Prism line-numbers plugin work? Or does that present issues when trying to update the highlight on code change?

Yes. Prism plugins causes errors. When the code changes we should also inform the plugins to re-render etc.
did you import the default styles? .prism-editor__code has margin-left:8px so there should be some space. If not you can add manually.

I did do import "vue-prism-editor/dist/VuePrismEditor.css" in my code, but no spacing.
I ended up adding a style manually. 👍 Nice that the flexbox keeps everything in place!

When the code changes we should also inform the plugins to re-render etc.

Base on this article we can tell Prism to update by doing something like
var block = document.getElementById('some-code')
Prism.highlightElement(block); // re-render?

Have you tried that approach?

@trusktr hi, i have an issue with my macbook's display(needs to be repaired) :( but i will check the article on mobile.

If it works, and it re-renders Prism line numbers, then it could eliminate the complexity from doing line numbers in vue-prism-editor.

Released new version v1 🎉


doppler: fix build failure with shell completion

Sets the HOME environment variable to a temporary dir prior to installing shell completion. The doppler cli attempts to run a setup routine which creates a directory under the user's home, so it needs something to exist first.
Resolves #325915
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[x] aarch64-darwin

For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)

[ ] sandbox = relaxed
[ ] sandbox = true

[ ] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[ ] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[ ] Tested basic functionality of all binary files (usually in ./result/bin/)
24.11 Release Notes (or backporting 23.11 and 24.05 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

Add a :+1: reaction to pull requests you find important.

@ofborg build doppler

I get the same builder error as ofborg on aarch64:
Unable to create config directory /build/tmp.NDEvKOalOj/.doppler
Unable to create config directory /build/tmp.NDEvKOalOj/.doppler
Doppler Error: mkdir /build/tmp.NDEvKOalOj/.doppler: file exists
Doppler Error: mkdir /build/tmp.NDEvKOalOj/.doppler: file exists
installShellCompletion: error: installed shell completion file `/nix/store/fvh2c26zkfxrbx366hrd1mj6qbk63myq-doppler-3.69.0/share/bash-completion/completions/doppler.bash' does not exist or has zero size

Looks good now, tested the build with nix build .#doppler and nix build .#pkgsCross.aarch64-multiplatform.doppler.

Result of nixpkgs-review pr 326008 run on aarch64-darwin 1

1 package failed to build:

doppler


feature: Convert labels into count for dot repeat

Did you check the docs?

[X] I have read all the flash.nvim docs

Is your feature request related to a problem? Please describe.
When using operator pending char mode f with jump_labels = true and you select another match then the first one, and then use dot repeat to repeat it, it acts as if the first occurrence of the character was pressed.
Describe the solution you'd like
It would be nice if the dot repeat operation was converted to a count operation instead, counting the number of matches between the start and the occurrence selected.
This would almost completely eliminate the need for counting in most cases.
Describe alternatives you've considered
I  can't really think of an alternative.
Additional context
BTW, I really like this mode with  jump_labels = true and label = { exclude = "" }, requiring me to confirm each motion with enter. It's a little bit slower in the best case, when the first match is the one you are trying to use, but a lot faster when it is not, especially in operator pending mode  where you would have operated on the wrong thing. Also selecting the label, is faster than repeating if there are more than one match between for me, and otherwise almost the same, since the reaction time is much longer than the time it takes to type the label.
Despite using vim/neovim for over 10 years, constantly make the mistake of not noticing that the same character occurs several times. It's also much closer to kakoune/helix, where you get the visual confirmation first.
The only small additional change I would make in the regular jump, non-operator pending mode, esc should take you back to the  original location, and enter confirm, useful if you make a typo for example.

And a bonus feature would be a special dot repeat that requires you to select the label again, but otherwise perform the same operation.


docs: sort and group sidebar items

API and Guides categories are expanded by default. A list of main classes is shown first (matching the old docs structure) and all other classes are grouped under the "Other" category.
Issues #8897, #8936

nice 👍


Would it be possible to open the Discussion?

🚀 The feature, motivation and pitch
I think it would be extremely useful if we could have the Discussion area. We could discuss the trivial stuff instead of starting an issue.
Alternatives
No response
Additional context
No response

Absolutely! Done: https://github.com/epwalsh/obsidian.nvim/discussions


Fix issues found by deepsource.io

Coverage decreased (-0.6%) to 80.195% when pulling 57239a40813b9c959f09d446ea52f505ae34639a on deepsource-fixes into 398ebe82a04d17e7977594edc1c0448dedf9e2a2 on master.


Access (render) images from the Wagtail API

Hey, thanks for an awesome library!
I'm wondering if there is a way to render image just by using actual REST API? As I'm unable to access file path from current implementation.

Hi @bgryszko - please use the Google Group for support requests.

Thanks @gasman, and sorry posting question here. Just if anyone stepped here while looking for solution, I've resolved it by serving images with tweaked https://github.com/torchbox/wagtail/blob/master/wagtail/wagtailimages/views/frontend.py to my needs.


Added gnss support

Gnns support and update to change livox SDK.
The livox sdk2 was commited from branch https://github.com/michalpelka/Livox-SDK2/tree/mp/potential_fix33.

Merged to development.


@plone/client - Agnostic Plone 6 RESTAPI client

This package is an agnostic client written in TypeScript and built on the top of @tanstack/query to query Plone 6 backend.
It should be possible to use it in React/Vue/Solid/Svelte projects.

Moving it to: https://github.com/plone/plone.restapi-client


Gradle not able to filter tests in inner class using categories

I have a test class that looks like this
@RunWith(Enclosed.class)
public classs OuterClass {

@Category(SomeCategory.class)
@RunWith(Parameterized.class)
public static class InnerClassOne{

        @Parameterized.Parameter
        public String currentTest = null;

        @Parameterized.Parameters(name = "{0}")
        public static List<String> getTests() {
            return getTests(SomeCategory.class);
        }

        @Test
        public void testMethod() {
        }
    }

@Category(SomeOtherCategory.class)
@RunWith(Parameterized.class)
public static class InnerClassTwo{
        @Parameterized.Parameter
        public String currentTest = null;
        @Parameterized.Parameters(name = "{0}")
        public static List<String> getTests() {
            return getTests(SomeOtherCategory.class);
        }
        @Test
        public void testMethod() {
        }
    }
}

Now when I try to run the test like gw test it is not able to filter the tests.
My gradle test task has something like this
useJUnit { JUnitOptions opts ->
                opts.includeCategories SomeOtherCategory
            }

Expected Behavior
Able to filter tests based on categories even for nested classes.
Current Behavior
no test is run
Steps to Reproduce (for bugs)
See above.
Your Environment

I think we generally have problems with @Enclosed. See also https://github.com/gradle/gradle/issues/2320 and https://github.com/gradle/gradle/issues/2319

Duplicate of https://github.com/gradle/gradle/issues/1153


hashsum/b2sum: when the checksum file is untagged, detect the size

Should fix tests/cksum/b2sum.sh

The test fails on Windows as there is no /dev/null.

Congrats! The gnu test tests/cksum/b2sum is no longer failing!

Good work :)