AvroParquetWriter can't save object who can have link to object of same type

When i try to write instance of UserTestOne created from following schema
{"namespace": "com.example.avro",
"type": "record",
"name": "UserTestOne",
"fields": [{"name": "name", "type": "string"},   {"name": "friend",  "type": ["null", "UserTestOne"], "default":null} ]
}
I get java.lang.StackOverflowError
Environment: parquet version 1.5.0
Reporter: Dmitriy / @dimaga
Note: This issue was originally created as PARQUET-129. Please see the migration documentation for further details.

Ryan Blue / @rdblue:
I think the correct resolution is to catch recursive schemas and fail. We could design a system for storing recursive records, but it would be a lot of work. So if we need this feature in the long term we can keep this open, but the short-term solution is to reject schemas like this.

Julien Le Dem / @julienledem:
related to discussion here:
https://github.com/Parquet/parquet-mr/issues/369
One approach is to have a setting with max depth and unroll the schema. Then fail if there's a record larger than that.

Peter Hubner:
Allowing for max depth would be a nice addition. In some cases users should not have a define a new proto just to use parquet, if their proto contains recursion.
Especially if recursion is explicitly allowed in protobuf.

Werner Daehn / @wernerdaehn:
Okay, I believe I handled the schema conversion properly with all potential side effects.
Would you or somebody else help adding the actual code for writing the data? That is way over my head at the moment...
https://github.com/apache/parquet-mr/pull/445
(Had to defer from the exact logic I described above. Approach is the same but instead of bringing all reused tables to the root level, I leave them in the sub structures to be backward compatible. And the root/child is implicit to the ID column.)

Werner Daehn / @wernerdaehn:
Gee, I am hitting the same old issues. Feel like stalking Ryan ;-)
Kidding aside, I would like to reopen that. If there is valid Avro data and I want to persist that in Parquet, what should I do? Failing at the Parquet write is too late, it would need to fail when creating the Avro message already. Imagine you have a Kafka server and people put all kind of Avro messages into it, long term persistence shall be Parquet.
The solution with the max-depth has the character of a workaround. Yes, it helps for 90% of the cases but....same argument as before.
Given my limited understanding of Parquet, I would redefine the problem as "How would you store that in a relational table?". Parquet wants to store all primitive fields of schemas and their nested schemas in single columns. Hence the problem redefinition makes sense, I hope. The answer would be then "By reusing the columns and adding a parent_key".
Example with above schema:
Input data shall be
{"Fritz", [Fritz-friend1: {"Walter", [Walter-friend1: {"Joe", null}, Walter-friend2: {"Jil", null}]]}
or rendered as a tree:
Fritz
..Walter
....Joe
....Jil
Converting that to a Parquet structure:
|id|name|friend|root|
|
|-|-|-|-|-|
|1|Fritz|2|true|
|
|2|Walter|3|false|
|
|3|Joe|null|false|
|
|4|Walter|5|false|
|
|5|Jil|null|false|

In other words:
1. Whenever you find a record definition in the Avro Schema the first time, create it.1. If that record definition is being reused by name (without actual definition of the fields) its data goes into the already created structure.1. If such a schema is used more than once, add the id and root column. The id can hopefully be an Parquet internal pointer exposed as number hopefully.1. In the nested column store the pointer instead of the actual record.    The nice thing about that is, it would delay the decision of the max-depth to the Spark query time. Such a table is easy to read with Spark, supports the full flexibility available in tree structures including unbalanced trees, recursions in the data, .. everything. And you do not need to change Spark or Parquet itself, it is just the logic within the AvroWriter.    How does that sound?   |

Miguel Costa:
Any update on this?

Ryan Blue / @rdblue:
@wernerdaehn, if you'd like to pick this up and implement something to get around the restriction, that would be great. A little more work has been done for this using Avro's logical types to break circular references. Check out this test for an example: https://github.com/apache/parquet-mr/blob/master/parquet-avro/src/test/java/org/apache/parquet/avro/TestCircularReferences.java
That doens't happen transparently, but I think that's similar to what you're proposing.

Werner Daehn / @wernerdaehn:
LogicalType.....how is that used to "break the circular references"? I did not get that idea. An Avro logical type is just a synonym for a datatype - simple (like timestamp->long) or complex. But how is that related to circular references? Isn't that more for the flattening approach??
I will have a look into it, okay. I am just so spanking new to these internals, hence scared a bit.

Brad Kennedy:
Is there anything planned to merge in @wernerdaehn's, pull request?


[New Port Request] Sleef

Library name:  Sleef
Library description:  SIMD Library for Evaluating Elementary Functions, vectorized libm and DFT
Source repository URL:  https://github.com/shibatch/sleef
Project homepage:   https://sleef.org/

Hi @Remotion
sleef has been added to vcpkg now, please update to the latest vcpkg to use this port.
Thanks for adding this port @luncliff.


consolidate scattered ex-distribution infra and tools docs

A lot of infra docs were formerly under Distribution docs, which have been "deprecated" but not actually moved to a new home, even though a lot of this infrastructure is quite critical, especially to CI. This PR creates content/product-engineering/engineering/infrastructure and content/product-engineering/engineering/tools so that these things that will likely never really change much and will be used by many teams can survive team splits and renames, and tries to consolidate docs here. We can assign owners in these pages (as I have for devx and Buildkite).

remove duplicated internal infrastructure page in Cloud DevOps and Distribution
move customer env replicas stuff previously in Distribution internal infrastructure into Delivery
migrate docs related to internal infrastructure and internal tooling out of Distribution
merge "Environments" page, which only talks about GCP, into a combined infrastructure/gcp page along with the commitments stuff formerly in Distribution
adds docs about currently available queues as requested in https://github.com/sourcegraph/deploy-sourcegraph-dot-com/pull/15085#pullrequestreview-824491838 (trying to find a home for this information prompted this PR)

why here and not docs.sourcegraph.com? because this pertains to more than just sourcegraph/sourcegraph, and explicitly is a matter related to internal infra

Neither the DevX team nor the Delivery team are taggable for review in this repo 🥲

Amazing work! Thanks for moving this over!


Add a 1-sec delay between VO invites.

VO API started giving time-out errors. We are testing is a 1 sec delay between the invites will solve the problem.
Change-type: patch

LGTM


List of Functions

Hello @shoyer
Let me congratulate you again for you work, I really think it's an important one and I hope you got the recognition.
That being said I would like to suggest that you add a list of the supported features, in especial for the legacyapi. NetCDF4 has lots of features and new ones are constantly added, so you can can not guaranty to support "most of the features of the netCDF interface". In special in NetCDF4, createVariable has an argument endian, also NetCDF4 has the mask and scale feature, I may be wrong, but it seems like h5netcdf don't have those features.

Thanks -- I'll do my best to get that together.
As for endian, h5py does not appear to expose this feature, so it wasn't an option to include.
And as for mask and scale, I intentionally omitted -- this is the sort of feature that is better handled (in my opinion) in client libraries, because there are multiple options for how the unmasked/scaled data should be stored (e.g., using masked array or normal numpy arrays of float marking missing values with NaN).

As a step toward this, I updated the readme with a list of functionality that I know we don't support.

As this is summarized in the README I'll close this.


Make core plugins that depend on colors fall back to global color palette if not specified explicitly

PRing this against config-restructuring to make the diff cleaner for now, but ultimately will be targeting the next branch once config-restructuring is merged.
This PR makes it so that changes to the colors object in the theme section of your config file are automatically inherited by the backgroundColors, borderColors, and textColors core plugins.
This means that instead of having to do this:
module.exports = {
  theme: {
    colors: {
      ...defaultTheme.colors,
      customColor: '#bada55',
    },
    backgroundColors: {
      ...defaultTheme.colors,
      customColor: '#bada55',
    },
    borderColors: {
      ...defaultTheme.colors,
      customColor: '#bada55',
    },
    textColors: {
      ...defaultTheme.colors,
      customColor: '#bada55',
    },
  },
}

...or this:
const colors = {
  ...defaultTheme.colors,
  customColor: '#bada55',
}

module.exports = {
  theme: {
    colors: colors,
    backgroundColors: colors,
    borderColors: colors,
    textColors: colors,
  },
}

...you can just do this:
module.exports = {
  theme: {
    colors: {
      ...defaultTheme.colors,
      customColor: '#bada55',
    },
  },
}

I still need to figure out a solution for the borderColors.default thing, because to make this PR work properly I also need to delete the backgroundColors, borderColors, and textColors sections from the default theme. Won't merge until I have that figured out.

Closing in favor of #645.


https://github.com/Rzarni12/skills-introduction-to-github/issues/1#issue-2763625180

          https://github.com/Rzarni12/skills-introduction-to-github/issues/1#issue-2763625180

Originally posted by @Rzarni12 in https://github.com/Rzarni12/skills-introduction-to-github/issues/1#issuecomment-2566685430

 https://github.com/Rzarni12/skills-introduction-to-github/issues/1#issue-2763625180


Enhancement request - Setting / updating alarm time

Since you recently added the 'Alarm Snooze' and 'Alarm Stop' and you can already read the 'Next Alarm', I'm wondering if it's possible to update existing alarm times from the API, or add new alarm times?
Context:
I currently use Apple Health bedtime to set my alarm time, which syncs up to Home Assistant to trigger all morning automation at the right time. Would be awesome if I could automate my Eight Sleep alarm time to sync up. (and maybe even set the Eightsleep bedtime when it turns on, although I personally wouldn't use that).
Awesome work on this custom integration! Love the active development and frequent updates! 🙌🏼

Hey, I looked into this and it seems like it would be quite difficult to find an intuitive way to implement it without a UI. When a routine gets created, is has a UID, so if you want to update it you have to include the UID in the API call.
With a UI (such as in the app) it's easier because all your routines are shown, and it knows which UID to include in the API call depending on which routine you click on. But from a HA service setup, it's not feasible for someone to include a UID in one of the fields. It would be possible to pull all the routines and expose their data, along with their UIDs in HA. Then the service call could use this data. However, that would take a lot of time to develop and would have a lot of possible issues due to the number of fields now possible with routines.

Ah yes, that makes sense, unfortunately.
I also have a Philips Somneo smart wake-up light, that (unofficial) Home Assistant integration just shows you 15 alarm slots each with 4-5 settings. It works for me, I just have the first alarm always synced, but it's a mess in HA and clunky.
I'm not sure if the routine UID changes? I assume it doesn't. You could one time manually figure out the UID, (or show a dropdown of all available values), and then have just 1-2 routine fields which you can sync with Home assistant.
It's not perfect. Deleting the routine in 8 Sleep would stop it work, you can't edit or turn off new routines created through the app. And if you want multiples routines in HA you need to change the existing routine rather than creating separate ones.
But if you stick with just 1-2 routines in the app and have Home Assistant (or use app to) change them it should keep working?
Another idea could even be to view each routine as a separate 'alarm clock' device in HA, just like each bedside is its own device. It could auto add / delete those devices based on the available routines in Eight Sleep. It would still be messy to find the right one in HA probably because they don't have names, but probably you only need to do that once in a while if you make a change to your routines.
Maybe if I have some time I'll try working on it myself if I can get the API call data from the app.

I hacked in a way to do this to my personal fork a while ago if you want a starting point. I spent a few days thinking about how to create a proper interface that could get merged back in, but it didn't really seem feasible without some major custom GUI work.
Anyway, you can check it out here: https://github.com/Dallas-J/eight_sleep

Any chance there is a way to trigger a one-off alarm as part of an automation? Say for example the dog is waiting by the front door in the middle of the night - a motion sensor picks that up and vibrates the bed to wake up one of the partners in the bed. No UI needed for this one I think? Since the use case is basically just wanting to trigger a wake up right now in response to another trigger.

Any chance there is a way to trigger a one-off alarm as part of an automation?

Exactly this.
If you could just activate the vibration and the thermal alarm (if that's not just turning the temperature up manually), you wouldn't even need to worry about syncing the times.


Link not working - Under contact section in README.md

Under Contact section
Links under Github teams section in Readme.md not working - Page not found

This is accessible but possibly only to org members
/close


timeZone, enableVNC capabilities are not passed

Pre-conditions:

selenium-webdriver for JS 4.5.0
selenoid, run under Docker (linux container under Docker Desktop)

Scenario:

Create new driver using remote selenoid url, and pass capabilities with timeZone other than timeZone where browser started:

const driver = new Builder()
     .usingServer(this.config_.selenoidAddress)
     .withCapabilities({
         timeZone: 'Europe/Madrid',
         enableVNC: true,
         ...capabilities
     })
     .build();

Start any web-application using web driver created in step#1 and observe timezone
Expected: the browser displays timezone from capabilities;
Problem: the browser displays timezone from server machine (default UTC from docker container)

The problem not reproduced with selenium-webdriver 4.4.0
Perhaps this related to selenium commit?
https://github.com/SeleniumHQ/selenium/commit/fa6deeea6bda1e73317157845772e114bd569b7d
I can't reproduce this with selenium grid, but looks like these capabilities are suitable only for selenoid?

Got an answer from Selenium team, that now any non-w3c capabilities should be send with specific suffix, and this works if use "selenoid: options" for timeZone.
I found an alternate if add TZ to browsers.json "ENV" section. But looks like this doesn't work with Edge.
@vania-pooh could you please assist is there possible way to set custom timezone from browsers.json for edge? Or any other similar way?
Thanks in advance

@StanislavKharchenko yes, correct answer is using env key under browsers.json or env capability under selenoid:options. So far as Edge for Linux is using the same Chromium engine, TZ environment variable should work. What kind of value are your trying to pass?

It was a problem with "Europe/Kyiv" timezone.
Edge accepts "Europe/Kiev", but Chrome "Europe/Kyiv".
Closing this issue.

@StanislavKharchenko eah, probably their timezone databases differ.


Fix unstable spec on circle ci

Fix #142 (maybe)

output = `#{gem} list`
p `$?.exitstatus` #=> 1
p output #=> looks successfully output

system("which #{gem}")
output = `#{gem} list`
p `$?.exitstatus` #=> 0
p output #=> looks successfully output

I'm confusing this behavior...
Maybe interpret with --seed 34923

Pressed CircleCI rebuild button with 5 times, then all builds are green.
Looks test is stable


helm: expose optional workspace paths while deploying the cluster

Closes reanahub/reana#532

Codecov Report

Merging #533 (e78ab1e) into master (24b5fee) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #533   +/-   ##
=======================================
  Coverage   15.03%   15.03%
=======================================
  Files          17       17
  Lines        1516     1516
=======================================
  Hits          228      228
  Misses       1288     1288

Impacted Files
Coverage Δ

reana/reana_dev/cluster.py
0.00% <ø> (ø)


Expand ingestion input formats to cover OPeNDAP, LAS and THREDDS

On a monthly basis, Chris pushes logs to the following location
ftp://podaac.jpl.nasa.gov/misc/outgoing/cjf/mudrod/
You will see that there are OPeNDAP, LAS and THREDDS as well. We should extend our input formats at https://github.com/mudrod/mudrod/blob/master/core/src/main/java/esiptestbed/mudrod/weblog/pre/ImportLogFile.java to cover the above cases. We should also revisit the structure of this class is it looks like better object orientation could be used.

@Yongyao can you please attempt to ingest logs from December locally? These can be obtained from the FTP site above.


Failing to export subschema results in silent failure on server on mongo update

It was my error to leave an "export default Place" out of the bottom of my Place.js file, but it caused a very silent error. The DB doesn't get updated, but there's no error message or anything, even if I try/catch things. Here's the situation:
Place.js:
const Place = new SimpleSchema({
  ...
});
//export default Place; <---with this line, works fine, without, silent failure to write to the DB

Venues.js;
import Place from './Place';
...
const Floor = new SimpleSchema({
  ...
  places: {
    type: Array,
    label: "Places",
    optional: true,
  },
  'places.$': { type: Place },  // <--- this is where place is used.
  ...
});

Venues.schema = new SimpleSchema({
  ...
  floors: {
    type: Array,
    label: 'Floors',
    optional: true,
  },
  'floors.$': { type: Floor },
  ...
});

Then, on the server, in Venues/methods.js:
...
 'Venues.addPlaceToFloor': function addPlace( venueName, floorNumberName, place ) {
    check(venueName, String);
    check(floorNumberName, String);
    check(place, Object);
    if ( Roles.userIsInRole( this.userId, 'admin' ) ) {
      // THIS FAILS TOTALLY SILENTLY IF I LEAVE OUT 'export default Place;' IN PLACE.JS
      Venues.update({"name": venueName, "floors.numberName":floorNumberName},
                     { $push: {"floors.$.places": place} } );
      return;
    }
    throw new Meteor.Error('500', 'You must be an admin to update things.');
  },
...

@RealHandy I had a look at why this would be and it looks like ESM interop with CJS means that importing a file without any exports returns an empty object {}.
While { type: undefined } throws an error, there's nothing stopping {type: {} } from working.
Then when it tries to use the schema, it's giving you the silent treatment.
I've whipped up a pull request to check for an empty object which catches errors like this and loudly throws an error so you can fix it

That’s quick work! Thanks for doing that — it’ll save some people some heartache for sure!

On Oct 11, 2018, at 9:31 PM, Frederick Stark<EMAIL_ADDRESS>wrote:
@RealHandy I had a look at why this would be and it looks like ESM interop with CJS means that importing a file without any exports returns an empty object {}.
While { type: undefined } throws an error, there's nothing stopping {type: {} } from working.
Then when it tries to use the schema, it's giving you the silent treatment.
I've whipped up a pull request to check for an empty object which catches errors like this and loudly throws an error so you can fix it
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub, or mute the thread.


Weave-Net Addon causing kernel panics on RPI 3B+.

What you expected to happen?
What I expected to happen: upon two weave pods discovering each other, weave to start working.
What happened?
The weave pod seems to execute some command that causes one of the two nodes connecting to each other to crash with a kernel panic. I'm guessing it's unlikely that weave itself is the root cause here, but I figure here is a good place to start.
Logs from the kernel are at the end of this issue.
How to reproduce it?
Setup kubernetes 1.9.7 on two nodes, and apply the K8s Weave addon using
$ kubectl apply -f "https://cloud.weave.works/k8s/net?k8s-version=$(kubectl version | base64 | tr -d '\n')" - this seems to install version 2.3.0 according to the pod descriptions from the API.
Wait a short amount of time for the pods to try and connect to each other.
Notice that one of the machines has rebooted, and the other is unable to connect to the first (as it has crashed).
Anything else we need to know?
Probably the most important part: both nodes in this case are running the latest version of Raspbian, as they are Raspberry Pi 3B+ machines. They are all located on a home network, with IPs <IP_ADDRESS>-5, statically assigned. These are configured using Ansible to an extent, and I might be able to share the scripts used if needed.
Versions:

$ weave version (found by exec-ing to a running pod awaiting connections)
/home/weave # ./weave --local version
weave 2.3.0

$ docker version
Docker version 18.04.0-ce, build 3d479c0

$ uname -a
Linux m1 4.14.34-v7+ #1110 SMP Mon Apr 16 15:18:51 BST 2018 armv7l GNU/Linux

$ kubectl version
Client Version: version.Info{Major:"1", Minor:"9", GitVersion:"v1.9.2", GitCommit:"5fa2db2bd46ac79e5e00a4e6ed24191080aa463b", GitTreeState:"clean", BuildDate:"2018-01-18T10:09:24Z", GoVersion:"go1.9.2", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"9", GitVersion:"v1.9.7", GitCommit:"dd5e1a2978fd0b97d9b78e1564398aeea7e7fe92", GitTreeState:"clean", BuildDate:"2018-04-18T23:58:35Z", GoVersion:"go1.9.3", Compiler:"gc", Platform:"linux/arm"}

Logs:
Before one node connects to the other, everything looks mostly fine. The initial connections are attempted to each of the three peers - .3, .4, and .5.
$ kubectl logs -n kube-system <weave-net-pod> weave
DEBU: 2018/06/11 05:43:56.878318 [kube-peers] Checking peer "ee:bf:2b:a9:06:ad" against list &{[{42:fc:dc:59:ea:96 m1} {3e:39:75:92:f1:9b m3} {02:f9:0c:1b:52:04 m3} {ee:bf:2b:a9:06:ad m1}]}
INFO: 2018/06/11 05:43:56.993279 Command line options: map[ipalloc-init:consensus=3 ipalloc-range:<IP_ADDRESS>/12 name:ee:bf:2b:a9:06:ad nickname:m1 datapath:datapath db-prefix:/weavedb/weave-net docker-api: host-root:/host http-addr:<IP_ADDRESS>:6784 metrics-addr:<IP_ADDRESS>:6782 no-dns:true port:6783 conn-limit:100 expect-npc:true]
INFO: 2018/06/11 05:43:56.993509 weave  2.3.0
INFO: 2018/06/11 05:43:57.589147 Bridge type is bridged_fastdp
INFO: 2018/06/11 05:43:57.589233 Communication between peers is unencrypted.
INFO: 2018/06/11 05:43:57.625030 Our name is ee:bf:2b:a9:06:ad(m1)
INFO: 2018/06/11 05:43:57.625248 Launch detected - using supplied peer list: [<IP_ADDRESS> <IP_ADDRESS> <IP_ADDRESS>]
INFO: 2018/06/11 05:43:57.628632 Checking for pre-existing addresses on weave bridge
INFO: 2018/06/11 05:43:57.645824 [allocator ee:bf:2b:a9:06:ad] Initialising with persisted data
INFO: 2018/06/11 05:43:57.651091 Sniffing traffic on datapath (via ODP)
INFO: 2018/06/11 05:43:57.662415 ->[<IP_ADDRESS>:6783] attempting connection
INFO: 2018/06/11 05:43:57.674431 ->[<IP_ADDRESS>:6783] attempting connection
INFO: 2018/06/11 05:43:57.674875 ->[<IP_ADDRESS>:6783] attempting connection
INFO: 2018/06/11 05:43:57.675066 ->[<IP_ADDRESS>:57939] connection accepted
INFO: 2018/06/11 05:43:57.675843 ->[<IP_ADDRESS>:6783] error during connection attempt: dial tcp4 :0-><IP_ADDRESS>:6783: connect: connection refused
INFO: 2018/06/11 05:43:57.676161 ->[<IP_ADDRESS>:6783] error during connection attempt: dial tcp4 :0-><IP_ADDRESS>:6783: connect: connection refused
INFO: 2018/06/11 05:43:57.679452 ->[<IP_ADDRESS>:57939|ee:bf:2b:a9:06:ad(m1)]: connection shutting down due to error: cannot connect to ourself
INFO: 2018/06/11 05:43:57.680866 ->[<IP_ADDRESS>:6783|ee:bf:2b:a9:06:ad(m1)]: connection shutting down due to error: cannot connect to ourself
INFO: 2018/06/11 05:43:57.699266 Listening for HTTP control messages on <IP_ADDRESS>:6784
INFO: 2018/06/11 05:43:57.700143 Listening for metrics requests on <IP_ADDRESS>:6782
INFO: 2018/06/11 05:43:58.690696 [kube-peers] Added myself to peer list &{[{42:fc:dc:59:ea:96 m1} {3e:39:75:92:f1:9b m3} {02:f9:0c:1b:52:04 m3} {ee:bf:2b:a9:06:ad m1}]}
DEBU: 2018/06/11 05:43:58.703575 [kube-peers] Nodes that have disappeared: map[]
INFO: 2018/06/11 05:43:59.078850 ->[<IP_ADDRESS>:6783] attempting connection
INFO: 2018/06/11 05:43:59.080194 ->[<IP_ADDRESS>:6783] error during connection attempt: dial tcp4 :0-><IP_ADDRESS>:6783: connect: connection refused
INFO: 2018/06/11 05:43:59.315638 ->[<IP_ADDRESS>:6783] attempting connection
INFO: 2018/06/11 05:43:59.316856 ->[<IP_ADDRESS>:6783] error during connection attempt: dial tcp4 :0-><IP_ADDRESS>:6783: connect: connection refused
INFO: 2018/06/11 05:44:02.806629 ->[<IP_ADDRESS>:6783] attempting connection
INFO: 2018/06/11 05:44:02.808304 ->[<IP_ADDRESS>:6783] error during connection attempt: dial tcp4 :0-><IP_ADDRESS>:6783: connect: connection refused
INFO: 2018/06/11 05:44:03.554820 ->[<IP_ADDRESS>:6783] attempting connection

Once one pod connects to another, it's random as to which one crashes (but one always does). All the "logs" of the kernel panic that I could get hold of are here:
Jun 11 05:28:31 m1 kubelet[785]: I0611 05:28:31.922238     785 kubelet.go:2118] Container runtime status: Runtime Cond
itions: RuntimeReady=true reason: message:, NetworkReady=true reason: message:
Jun 11 05:28:32 m1 kernel: [ 2162.741648] Unable to handle kernel NULL pointer dereference at virtual address 00000000
Jun 11 05:28:32 m1 kernel: [ 2162.744896] pgd = 921c0000
Jun 11 05:28:32 m1 kernel: [ 2162.747989] [00000000] *pgd=19c2c835, *pte=00000000, *ppte=00000000

Message from syslogd@m1 at Jun 11 05:28:32 ...
 kernel:[ 2162.751060] Internal error: Oops: 80000007 [#1] SMP ARM
Jun 11 05:28:32 m1 kernel: [ 2162.751060] Internal error: Oops: 80000007 [#1] SMP ARM
Jun 11 05:28:32 m1 kernel: [ 2162.754243] Modules linked in: xt_NFLOG veth dummy vport_vxlan vxlan ip6_udp_tunnel udp_
tunnel openvswitch nf_conntrack_ipv6 nf_nat_ipv6 nf_defrag_ipv6 nfnetlink_log xt_statistic xt_nat xt_recent ipt_REJECT
 nf_reject_ipv4 xt_tcpudp ip_set_hash_ip xt_set ip_set xt_comment xt_mark ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_con
ntrack_netlink nfnetlink iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 xt_addrtype iptable_filter xt_conntr
ack nf_nat nf_conntrack br_netfilter bridge stp llc overlay cmac bnep hci_uart btbcm serdev bluetooth ecdh_generic evd
ev joydev sg brcmfmac brcmutil cfg80211 rfkill snd_bcm2835(C) snd_pcm snd_timer snd uio_pdrv_genirq fixed uio ip_table
s x_tables ipv6

Message from syslogd@m1 at Jun 11 05:28:32 ...
 kernel:[ 2162.816788] Process weaver (pid: 1896, stack limit = 0x92190210)

Message from syslogd@m1 at Jun 11 05:28:32 ...
 kernel:[ 2162.820871] Stack: (0x921919f0 to 0x92192000)

Message from syslogd@m1 at Jun 11 05:28:32 ...
 kernel:[ 2162.824936] 19e0:                                     00000000 00000000 0500a8c0 92191a88

Message from syslogd@m1 at Jun 11 05:28:32 ...
 kernel:[ 2162.829076] 1a00: 0000801a 00008bad b88a5bd0 b88a5b98 92191d2c 7f637ad0 00000001 92191a5c

Message from syslogd@m1 at Jun 11 05:28:32 ...
 kernel:[ 2162.833081] 1a20: 23d23b00 00000000 b88a5bd0 99ed4000 00000050 b406e000 00000000 99ed4050

Message from syslogd@m1 at Jun 11 05:28:32 ...
 kernel:[ 2162.837243] 1a40: 00000000 00008bad 00000040 0000801a 92191a68 00002100 00000000 00000000

Message from syslogd@m1 at Jun 11 05:28:32 ...
 kernel:[ 2162.841436] 1a60: 00008000 0000ee47 00000002 0500a8c0 00000000 00000000 00000000 00000000

Message from syslogd@m1 at Jun 11 05:28:32 ...
 kernel:[ 2162.845629] 1a80: 00000000 00000000 0300a8c0 00000000 00000000 00000000 00000000 00000000
Shared connection to m1 closed.

@12wrigja Thanks for the issue.
In the provided syslog logs of the oops there are no content of general purpose registers. Could you check whether they are in dmesg?

Although I don't have evidence, but the kernel version rings a bell: https://github.com/coreos/bugs/issues/2382.

Just checked, and indeed, the latest raspbian is prone to the kernel bug mentioned in my comment above, as https://github.com/raspberrypi/linux/tree/raspberrypi-kernel_1.20180417-1 misses the fix: https://github.com/torvalds/linux/commit/f15ca723c1ebe6c1a06bc95fda6b62cd87b44559#diff-4f541554c5f8f378effc907c8f0c9115.
To workaround, you can disable fastdp by re-deploying your cluster with  kubectl apply -f "https://cloud.weave.works/k8s/net?k8s-version=$(kubectl version | base64 | tr -d '\n')&env.WEAVE_NO_FASTDP=1". You might need to remove the "weave" interface if it exists before the re-deploy.

@12wrigja OT: Did you compile Weave Net yourself? Many are struggling with running it on RPI 3 B+ due to invalid image arch: https://github.com/weaveworks/weave/issues/3276.

I'm also experiencing this issue, I've been actually trying to set it up without any success. Sadly no logs from Kubernetes and most of the times my pi (3B+) reboots.
uname -a
Linux black-pearl 4.14.34-hypriotos-v7+ #1 SMP Sun Apr 22 14:57:31 UTC 2018 armv7l GNU/Linux

$ sudo docker version
Client:
 Version:       18.04.0-ce
 API version:   1.37
 Go version:    go1.9.4
 Git commit:    3d479c0
 Built: Tue Apr 10 18:25:24 2018
 OS/Arch:       linux/arm
 Experimental:  false
 Orchestrator:  swarm

Server:
 Engine:
  Version:      18.04.0-ce
  API version:  1.37 (minimum version 1.12)
  Go version:   go1.9.4
  Git commit:   3d479c0
  Built:        Tue Apr 10 18:21:25 2018
  OS/Arch:      linux/arm
  Experimental: false

@arnulfojr Have you tried following the workaround suggested above?

Following up here:

using docker inspect weaveworks:weave-kube:2.3.0, I get apparently an amd64 image, that seems to run just fine on my rpi 3B+. Is the output from inspect wrong? See https://gist.github.com/12wrigja/19b8074a00a565dc089941a4a28d744f for the results of inspecting.
disabling fastdp seems to have fixed my issues. I then noticed that my Pod and Service CIDR's were overlapping, changed Weave to use the right CIDR, and now I'm good to go.

I subscribed to the issue you created for the rpi kernel, and would be happy to test any fixes they release.

@12wrigja Thanks for the follow up.

Is the output from inspect wrong?

Interesting. The Architecture field is set to amd64 and when I inspect the image with manifest-tool I cannot find the image you inspected among all returned.

@arnulfojr Could you answer to my question above?

@brb So indeed, is the fastdp, sorry I started over from scratch and took me a while to flash the SD cards.
So far, deactivating it avoids the kernel panic. I'm using weave as a plugin with Kubernetes and finally they all came to life! for the mean time, it would be cool if you can post officially somewhere about the kernel issue, so people having the issue can easily track it down. Furthermore, I still have the amd64 image when kube pulls the weave-kube:2.3.0 and weave-npc:2.3.0 image tho.
I still have to test it with usage but so far my issue got away by deactivation the fastdp. From an expert to a newbie, what's the drawback of deactivating it?
Thanks a lot for the issue entries to the Pi kernel repo!
$ kubectl get nodes
NAME              STATUS    ROLES     AGE       VERSION
black-pearl       Ready     master    10m       v1.9.8
flying-dutchman   Ready     <none>    5m        v1.9.8
wicked-wench      Ready     <none>    1m        v1.9.8

@arnulfojr
Thanks.

what's the drawback of deactivating it?

The non-fastdp mode which also known as sleeve is slower and consumes more CPU cycles. Please see for more details: https://www.weave.works/blog/weave-docker-networking-performance-fast-data-path/

it would be cool if you can post officially somewhere about the kernel issue

Agreed. We are going to update our docs to include known issues.

I'm still trying to help identifying the source of the problem.
And I'm fighting with the "fastdp" mode:  I understood that a "weave reset --force" is mandatory to make "weavenet" run again, even on X86.
During the tests, I got a kernel crash log on my PI (notice that I have a 32bits kernel running):

Message from syslogd@s-pituum-01 at Jun 12 18:18:43 ...
kernel:[  466.052644] Internal error: Oops: 80000007 [#1] SMP ARM

For info:

s-pituum-01% uname -a
Linux s-pituum-01 4.14.34-v7+ #1110 SMP Mon Apr 16 15:18:51 BST 2018 armv7l GNU/Linux

I understood that a "weave reset --force" is mandatory to make "weavenet" run again

I may be missing some context: this command is necessary if Weave Net is not running and you want to tear down all the supporting structures.  For instance if you want to move from fastdp to sleeve.
In many cases a reboot is an easier option, and will make everything go away except the IP allocation data.

I don't have a clear understanding of why this is necessary, but the "weave net" container crashed during launch when switching from "fastdp" to "non fastdb" (even on X86 where it also ran without any problem).
I guess that the reset removed the virtual network bridges so that the next launch recreates the with with the correct characteristics.

An update about my latest tests.
I launched the weave container with the "fastdp"" disabled:

$ WEAVE_NO_FASTDP=1 ./WEAVE/weave launch --no-restart

And the container is now running for about a whole day:

s-pituum-01% docker ps
CONTAINER ID        IMAGE                    COMMAND                  CREATED             STATUS              PORTS               NAMES
6db76666a184        weaveworks/weave:2.3.0   "/home/weave/weaver …"   18 hours ago        Up 18 hours                             weave

With "fastdp"activated, the container generates the kernel crash we are discussing here after about one minute.
In fact, this is a satisfactory workaround for me.

According to https://github.com/raspberrypi/linux/issues/2580#issuecomment-400258418, the issue is going to be fixed in the next Raspbian release or it has been already fixed in raspberrypi-kernel package.
Could someone try updating the package and running Weave Net with fastdp? Thanks.

Martynas,
I updated my raspberry pi's to use the latest kernel provided by running rpi-update (4.14.52-v7+ in my case), adjusted my weave daemonset to re-enable fastdp, and restarted all my nodes and everything works fine - weave-kube reports it's using bridged_fastdp and none of my nodes crash.

Thanks @12wrigja; I'll close this issue based on your report.

One more confirmation: I upgrade my Raspbian with a standard "apt upgrade" which upgraded my kernel.
Everything works now as expected.

@bernhara Thanks for letting us know.

I have this problem too. Would a full dump of the OOPS help you?
Message from syslogd@k2 at Dec 16 22:48:38 ...
  Since you report the same kernel version I don't see any reason to look further.
A workaround is described at https://github.com/weaveworks/weave/issues/3314#issuecomment-396257270

Posting to confirm that running rpi-update and then restarting my raspberry pi allows weave net pods to run without a hitch. Thanks to everyone's collaboration 👍
Just to add my experience... I'm following this medium guide to set up a k8s pi cluster to set up a 5 node k8s pi cluster, and discovered that weave net pods are problematic if you strictly follow this article's commands ( it happens 😏 ).
Here are the pi models in my cluster:
* Raspberry Pi 4 Model B Rev 1.1 2GB
* Raspberry Pi 4 Model B Rev 1.1 1GB
* Raspberry Pi 3 Model B Plus Rev 1.3 1GB
* Raspberry Pi 3 Model B Rev 1.2 1GB
* Raspberry Pi Model B Plus Rev 1.2 512MB

(command to acquire this info: cat /proc/device-tree/model && echo && free -m)
I decided to make the Raspberry Pi 3 Model B Plus Rev 1.3 my k8s master node and saw that weave net entered into a k8s crash loop after . Running rpi-update and then sudo reboot afterwards allowed pi 3 B+ to run weave net (yeet). Time to keep bumping through the "setup" article. Cheers all!


epic(integrations): #534 enable error handling for integrations and refactoring integrations

Description

PR for epic https://github.com/it-at-m/digiwf-project/issues/534

Refactoring digiwf-integrations
Refactoring streaming/messaging libs to simplify usage
Implement error handling for integrations

Reference
Issues: #173, #50, #163, #164, #165, #166

It was a good idea to crate this branch to have a stable branch for longer period of time, but let's merge integration one after another and not wait for all.


Nicer readme.

Next step is to reorder properties, because now they are messy. Combine they by types/purposes ( *button related, sceneStyle related, etc)

While you're in there, might as well make the 0.22 requirement more prominent (at least bold, maybe moved to top) to avoid a lot of confusion.


Feat(Tekla) : receive instances in Tekla

Description & motivation

Changes:

Use standardized GraphTraversal to flatten commit instead of previous traversal method
Check if object is instance before converting the object's mesh
The two decendents of Instance, blockInstance and RevitInstance, both has a method called GetTransformedGeometry(). As far as I can tell, this method is never used. I moved this to the base class with a couple virtual methods so each implementation can tweak the behavior of the method.

To-do before merge:

Screenshots:

Validation of changes:

Instance meshes now receive correctly in Tekla

Checklist:

[x] My pull request follows the guidelines in the Contributing guide?
[x] My pull request does not duplicate any other open Pull Requests for the same update/change?
[x] My commits are related to the pull request and do not amend unrelated code or documentation.
[x] My code follows a similar style to existing code.
[ ] I have added appropriate tests.
[ ] I have updated or added relevant documentation.

References

Yass!


Update proto files for pagination

Related to PR #2097
Ref #520

@eleftherias Just a question: the last commit from main on my local branch was https://github.com/stacklok/minder/commit/e370b08cd8472ac4b5dc9145862bab34a97a56af, and make gen is clean, i.e. not updating any files. So, I'm assuming this is version-related.
Local dependency should stick to protoc-gen-go v1.31.0 right?


How to add extra fonts and bookmarks?

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Describe the solution you'd like
A clear and concise description of what you want to happen.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.

Hi! technophilix
You should be able to find what you're looking for in the following demo branch.
If you can't find it on that branch, please let me know.


[RayService] Add support for multi-app configs

Why are these changes needed?

Related issue number

Checks

[ ] I've made sure the tests are passing.
Testing Strategy

[ ] Unit tests
[ ] Manual tests
[ ] This PR is not tested :(

Should we close this PR?

Closing in favor of a separate approach in https://github.com/ray-project/kuberay/pull/1156


There is no --solution-zip flag for pack/unpack

There is no --solution-zip flag for pack/unpack

@temmyraharjo  Thanks for pointing the incorrect parameters out.  I fixed them and am closing this PR.


HoloMap crash with matplotlib using %opts Points (s=...)

Dear Holoviews developers,
There seems to be a problem with hv.Points plot in HoloMap in the recent holoviews (v 1.11.0). If I set %opts Points (s=50) or any other value it crashes:
I'm trying to reproduce the holomap example using hv.Points instead of hv.Curve:
import numpy as np
import holoviews as hv
hv.extension('matplotlib')

%opts Points (s=50)

frequencies = [0.5, 0.75, 1.0, 1.25]

def sine_curve(phase, freq):
    xvals = [0.1* i for i in range(100)]
    #return hv.Curve((xvals, [np.sin(phase+freq*x) for x in xvals]))
    return hv.Points((xvals, [np.sin(phase+freq*x) for x in xvals]))

curve_dict = {f:sine_curve(0,f) for f in frequencies}

hv.HoloMap(curve_dict, kdims='frequency')

The error message:
...
C:\ProgramData\Anaconda3\lib\site-packages\holoviews\plotting\mpl\chart.py in update_handles(self, key, axis, element, ranges, style)
    668         paths.set_offsets(np.column_stack([xs, ys]))
    669         if 's' in style:
--> 670             paths.set_sizes(style['s'])
    671         if 'vmin' in style:
    672             paths.set_clim((style['vmin'], style['vmax']))

C:\ProgramData\Anaconda3\lib\site-packages\matplotlib\collections.py in set_sizes(self, sizes, dpi)
    871         else:
    872             self._sizes = np.asarray(sizes)
--> 873             self._transforms = np.zeros((len(self._sizes), 3, 3))
    874             scale = np.sqrt(self._sizes) * dpi / 72.0 * self._factor
    875             self._transforms[:, 0, 0] = scale

TypeError: len() of unsized object

I was wondering if you know how to change the point size correctly in this case?
In the earlier holoviews version 1.9.1 the same example works perfectly well.
Many thanks!
Best regards,
/Alexey

I'm sorry, you have closed this issue, but it is still present in the latest holoviews (v 1.11.2):
The same example gives the same TypeError:
I was wondering if there is some workaround to avoid this error? I would really like to change the default size of Points (they are too big for large data sets).
`import numpy as np
import holoviews as hv
print(hv.version)
hv.extension('matplotlib')
%opts Points (s=50)
frequencies = [0.5, 0.75, 1.0, 1.25]
def sine_curve(phase, freq):
xvals = [0.1* i for i in range(100)]
#return hv.Curve((xvals, [np.sin(phase+freqx) for x in xvals]))
return hv.Points((xvals, [np.sin(phase+freqx) for x in xvals]))
curve_dict = {f:sine_curve(0,f) for f in frequencies}
hv.HoloMap(curve_dict, kdims='frequency')`

1.11.2

TypeError                                 Traceback (most recent call last)
C:\ProgramData\Anaconda3\lib\site-packages\IPython\core\formatters.py in call(self, obj, include, exclude)
968
969             if method is not None:
--> 970                 return method(include=include, exclude=exclude)
971             return None
972         else:
...
C:\ProgramData\Anaconda3\lib\site-packages\holoviews\plotting\mpl\chart.py in update_handles(self, key, axis, element, ranges, style)
671         paths.set_offsets(np.column_stack([xs, ys]))
672         if 's' in style:
--> 673             paths.set_sizes(style['s'])
674         if 'vmin' in style:
675             paths.set_clim((style['vmin'], style['vmax']))
C:\ProgramData\Anaconda3\lib\site-packages\matplotlib\collections.py in set_sizes(self, sizes, dpi)
871         else:
872             self._sizes = np.asarray(sizes)
--> 873             self._transforms = np.zeros((len(self._sizes), 3, 3))
874             scale = np.sqrt(self._sizes) * dpi / 72.0 * self._factor
875             self._transforms[:, 0, 0] = scale
TypeError: len() of unsized object
Many thanks!
/Alexey

Can't seem to reproduce this issue now, could you also report your matplotlib version?

Nevermind the fix didn't actually make it into 1.11.2. I'll be releasing 1.11.3 shortly so just update to that.


[bug] canceling a job while its active still makes the final status as "completed" rather than "cancelled".

This could be either a race condition or mis-configuration @gkumar9 .
How many worker nodes do you have?
If you cancel the job on one worker node whilst the other node is just finishing the job, it would cause this issue.

I have only one worker @grantcarthew .
While listening to events I noticed that first cancelled is called and then completed event.

Sorry @gkumar9, I've been busy working on this: https://github.com/grantcarthew/node-perj
I'm not using RethinkDB at the moment so you are going to have to help with the debugging.
Is this a repeatable issue?

yes

I'm happy to help you understand the code however I'm working on other projects right now. What tool do you want to use for casual chat? It used to be an easy choice. Not so much now. For instant messaging I use Signal however time zones can cause issues there. There's gitter, slack, etc.


Support negative glob patterns

Upgrading  a comment by @am11 to an issue: https://github.com/Microsoft/msbuild/issues/1794#issuecomment-286972038
<ItemGroup>
  <None Remove="!**/*.cs" /> <!-- remove all but the CS files -->
  <None Include="!**/*Actors*" /> <!-- include all but the paths with `Actors` in the name -->
</ItemGroup>

.gitignore example: https://git-scm.com/docs/gitignore#_pattern_format

A downside: this would make it much harder to do "static analysis" on msbuild code, since it would make it much harder to find the places where items are excluded. Right now you just have to scan for Excludes and Removes. With a negative pattern, it becomes a bit impossible to do statically:  <None Include="$(MayOrMayNotBeAnExclamationMark)**/*Actors*" />

This seems like it would be too complicated for the engine to support and implement for what we would get out of it. Closing.


Why doesn't labelImg recognize this label?

Hi,
I'm quite new to this, built a small program to horizontally mirror my labelled images and their labels, but it seems it doesn't find the labels after mirroring them? It's very very strange.
Basically, I labelled images using labelImg.
Then I wanted to mirror all of that to get more data.
So I wrote a little program, basically doing the following for each image:

Flip the image, save under new name {imageName}_flipped.jpg
Read PascalVOC label file
Change <filename> and <path> so they also have _flipped at the end of the name
Mirror label (changing xmin/xmax)
Write mirrored label data to new label file, also appending _flipped to the name

But for some reason, labelImg now doesn't recognize the old labels when opened, although I didn't actually change the original files.
It does however recognize the mirrored labels on the mirrored images.
Any ideas?

OS: Windows

PyQt version: 5.15.6

Example original label file:

Example flipped label file:

Files:

Above examples of label XML files are incomplete. Can you provide the full contents of the XML files?


Last Week in Pony - July 23, 2017

Not specifically pony:
https://www.infoq.com/presentations/panel-languages-future?utm_source=twitter&utm_medium=link&utm_campaign=calendar
QCon London panel: "Panel: What's Next for Our Programming Languages?"  featuring Sylvan amongst others (Joe Duffy, Brian Goetz)

RFC in final comment period:
https://github.com/ponylang/rfcs/pull/95

RFC accepted:
https://github.com/ponylang/rfcs/pull/93

Audio from the July 19, 2017 pony development sync:
https://pony.groups.io/g/dev/files/Pony Sync/July 19, 2017

RFC in final comment period:
https://github.com/ponylang/rfcs/pull/96

Issue opened to remove LLVM 3.7 support:
https://github.com/ponylang/ponyc/issues/2063

LLVM 4.0 support is on the way:
https://github.com/ponylang/ponyc/pull/2061

Alpine Linux support is landing on master:
https://github.com/ponylang/ponyc/pull/1844


problems with downloading the model

Hello, cannot download indic-en model, Could you, please, upload it

hey,
we are having some problems with GCP where we host our models.
We will have a temporary download link ready in sometime and let you know

Is there any update on the issue?

hi @gowtham1997, any luck with hosting the models? we are trying to run an experiment for a conference and wanted to include this model.

Hey guys,
This issue has been resolved

@gowtham1997 - able to download the models now. thanks

@gowtham1997  thanks a lot, everything's ok


Fix for strictNullChecks & external package

This PR makes the generated code compatible with strictNullChecks: true
This PR allows the generated code to be in a separate npm package, fixes Microsoft/TypeScript#9944

@katemihalikova, could you, please, explain concretely on our case the second point (generated code in separate npm package)? Thx

Sure. We are having a separate package with just the generated code that is build using ngc separately from the app. Because of Microsoft/TypeScript#9944, anything related to exported types and properties that originates in a dependency (like Observable) must be imported to make the build working.
This is done with e.g. import {Observable} from 'rxjs/Observable';.
But because it is still desirable to support "noUnusedLocals": true compile option, the imported type must be used somewhere so I decided to make the type explicit. That means that the type is correctly inferred, but is added just to fix the "noUnusedLocals": true problem.

I suggest to abandon this one for now. Do you agree?


Instrument testing crashes app after reloading a ROM

If a ROM and track are loaded, loading a new ROM (or reloading the same one) will cause the music to get unloaded, but instruments will still be listed on the instruments tab. Selecting an instrument and trying to test it will cause the app to crash.

Load ROM
Select BGM
Load ROM
Go to Instruments tab
Select an instrument
Click on the "Instrument test" section.

This happens when loading a ROM in general. When you first open a ROM, the current packs are all set to FF, and you can view a garbage list of instruments in the instrument test and cause a crash.


Write the introduction.

I'm happy to take this on (based on my suggested structure - please do say if anyone would rather a different structure/approach...). I realistically won't get to it before 2015-08-21.

Go for it.

I've just pushed a basic first draft of the introduction: f1d5e9f9eff157dfb7d54109586ca1339099b490
It's disjointed and not as smooth as I'd like it but I'm only ever getting 30 minutes here and there in between meetings and teaching so probably best for someone else to take a look.
Some comments:

I've also reorganized the repo slightly (3 directories: tex, img and scripts).
Bibs are not tidy, have left them just appearing generically based on my manager output, I suggest we fix those at a later stage (depending on the journal we go for it'll be easy to use template etc...).

I know I worked directly on master but suggest from now we each work on branches and discuss on PRs?
@marcharper said he'd take a look at intro and I'm sure he could/add improve the lit review so perhaps it's best for him to work on next?

I made some edits on a new branch.

Awesome, I'm more or less out tomorrow but will check through on Thursday!
:)
On Tue, 3 Nov 2015, 23:37 Marc Harper, PhD<EMAIL_ADDRESS>wrote:

I made some edits on a new branch
https://github.com/Axelrod-Python/An-open-reproducible-framework-for-the-study-of-the-iterated-prisoners-dilemma/tree/marc
.
—
Reply to this email directly or view it on GitHub
https://github.com/Axelrod-Python/An-open-reproducible-framework-for-the-study-of-the-iterated-prisoners-dilemma/issues/5#issuecomment-153524622
.

Have opened a PR to chat but basically looks great to me. #8


Some suggestions about conf file dir for Nix pm.

I am preparing gogs package to "functional" package manager NIX (nixos). There is an issue about custom conf. Hard fixed directory /etc/custom/conf makes some pain inside NIX pm.
Is it possible someway to set custom conf directory via env variable?

This is already possible (or at least - it works on my machine!). The GOGS_CUSTOM environment variable can be used to control the location.
I've got a set of debhelper scripts for packaging Gogs for Debian/Ubuntu - in my .deb package, I place my custom config file here: /etc/gogs/conf/app.ini then, in the service's unit file, I call gogs with: GOGS_CUSTOM=/etc/gogs set as an environment variable.

GOGS_CUSTOM is about only config or it influence other params?

I just did a test search of the repository. Looks like it also controls the expected location of 'robots.txt':

	...

	CustomPath = os.Getenv("GOGS_CUSTOM")
	if len(CustomPath) == 0 {
		CustomPath = workDir + "/custom"
	}

	if len(CustomConf) == 0 {
		CustomConf = CustomPath + "/conf/app.ini"
	}

	...

	HasRobotsTxt = com.IsFile(path.Join(CustomPath, "robots.txt"))

Thanks a lot.


PD: Add thermocycler to 'unused module' export warning

Background
We display these modals when users try to export a protocol where they have an unused module

Acceptance Criteria

[ ] Add a modal for when the Thermocycler is the only unused module in a protocol
[ ] Add an unused Thermocycler to the list of potential cases in the module that covers multiple unused modules

The current logic for displaying unused modules covers TCs on the deck.


Support for minDate and maxDate for months and years calendar.

Added:

support for minDate and maxDate for months calendar.
support for minDate and maxDate for years calendar.
added 2 more examples in the basic example.

minDate and maxDate only apply a disabled classname to the filtered items in the calendar in the exact same way it is done for the full fledged calendar. It also works for calendar that drill down from years, to months, to days: minDate and maxDate applies across.
As for the original unit tests, there is no tests added for minDate and maxDate (maybe as they only affect the rendered markup ?)

Can someone give it a try ? Take a look ?

Ok I couldn't be satisfied without tests so I wrote 2 unit tests anyway.

Just ran the thing to make sure it works. Looks good! :+1:

:-)

@camjackson Ran my visual tests (npm run examples) and the unit tests again. Should be good.

@camjackson Ready for one more look


Health probe configuration is missing

Team,
HTTP health probe configuation is missing.
According to screenshots, HTTP probe with HealthProbe.aspx should be used.
However, the next screenshot shows TCP:80.
I did not notice second hidden settings, it made me a bit in stuck.
Fix is easy -> pls replace screenshot with ASPX with TCP one.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: bc7e0331-9d68-1430-9b52-872104c8f838
Version Independent ID: af5762f8-05d6-e98c-fef8-17cd9e22b9ec
Content: Tutorial: Load Balancer VMs across availability zones - Azure portal
Content Source: articles/load-balancer/tutorial-load-balancer-standard-public-zone-redundant-portal.md
Service: load-balancer
GitHub Login: @asudbring
Microsoft Alias: allensu

@YanumVlad Thanks for the feedback! For the instructions to work as-is, you would need to create a page called healthprobe.aspx. You could also point it to your homepage, or use the TCP probe.
I have assigned the issue to the content author to evaluate and update as appropriate.

Created a work item for this month sprint to change probe to TCP for the tutorial to make it clearer.
#please-close


Evaluation of Python bindings vs. pure Python

What?
We will consider the options for writing Python bindings to https://github.com/google/differential-privacy/blob/main/cc/algorithms/numerical-mechanisms.h vs Pure Python.
There is a discussion document to list pro/cons 📝  https://docs.google.com/document/d/1PfQ6iJ858HcK4DkWuSpkIaOsc4_YMchTpG8vbcQy3Bk/edit?usp=sharing
Items to consider:

Is Python slower? (Suggest to research this by benchmark testing.)
Is memory management complicated?
Is Python readability an issue? (Compared to Go version, the templated C++ is complex looking.)
Are types/type conversions an issue, due to the nature of the secure noise problem, eg. rounding?
Which Python binding libraries would be best? (Suggested https://github.com/OpenMined/PyDP, CFFI, PyBind11, others?)

How long?
Perhaps a week?
Is your research related to a problem?
This relates to #11 Secure noise issue.
Additional Context
Could utilize existing benchmark test for LaPlace: https://github.com/google/differential-privacy/blob/f3e565a14b7d48869b650483de897eebc89ad494/go/noise/noise_test.go#L38

@AbinavRavi @walexi @say-yam

👋 Added a discussion document which you should all have access to: https://docs.google.com/document/d/1PfQ6iJ858HcK4DkWuSpkIaOsc4_YMchTpG8vbcQy3Bk/edit?usp=sharing

The decision to use Python binding to C++ implementation was made


Convert excel file to zip

Hello,
i am creating excel file using method
$excel = Excel::create($file_name, function($excel) use($submitData) {
$excel->sheet('Sheetname', function($sheet) use($submitData) {
$sheet->fromArray($submitData, null, 'A1', false, false);
});
});
$hash='ashish';
system('zip -P '.$hash.' '.$file_name.'.zip '.$file_name.'.xls');
There is an error like
Unable to open file for reading.Please suggest me where i am getting wrong.

This generally happens when php can not find the file or open it in the read only format. It could also be due to incorrect permissions.
Try using full path for the file, or better yet, use a package like Zipper


Rename SICP-JS backend environment variable

Description

Renamed SICP-JS environment variable to REACT_APP_SICPJS_BACKEND_URL and updated the README.
The previously badly named REACT_APP_INTERACTIVE_SICP_DATA_URL is not consistent with the URLS for other backends, and has caused confusion in the past.
Type of change

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[x] This change requires a documentation update
[x] Code quality improvements

How to test

Check if pages can still be loaded. No functionality changes here, just a change in variable name.
Checklist

[x] I have tested this code
[x] I have updated the documentation

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

2 of 2 (100.0%)  changed or added relevant lines in 2 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 29.936%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
3178

Relevant Lines:
9793

💛  - Coveralls

thanks @chownces for the review!


[ADL] Media prformance range fix for ww05

Tracked-On: OAM-105744
Signed-off-by: vdanix<EMAIL_ADDRESS>

Will this be ported to horizontal?

Will this be ported to horizontal?

No, These fixes for vertical only


fix menu router prop bug when vertical mode

Please makes sure these boxes are checked before submitting your PR, thank you!

[ ] Make sure you follow Element's Contributing Guide.
[ ] Rebase before creating a PR to keep commit history clear.
[ ] Add some descriptions and refer relative issues for you PR.

#295


Updating Amazon S3 limited access banner

Proposed changes
Updated limited access banner with a date and additional information.
Merge timing
On 2/7, after the language is approved by Legal.
Related issues (optional)
#2265
[netlify-build]

As a note: this has to be approved by Legal before it can be merged: date on approval is TBD

Approved by legal on 2/3, good to go out in the next scheduled docs release!


chore: New underline variant for the Tabs component

Proposed changes (including videos or screenshots)

Created a new underline variant for the Tabs component, which adds a big square underline underneath the tab items
Demo image:

Issue(s)

Further comments

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.


Add white background in export; set default filename

Since the adoption of Tldraw in 2.6, the whiteboard started to support transparency in file uploads.
One of these transparent presentatation comes from the "Move notes to whiteboard" feature. When users switched to dark mode, the text became unreadable.
This PR adds a default white background on all exports to match the previous behavior. Additionally, it sets the name of the generated file to match the one used in the meeting when moving notes to the presentation area.

Closes:
#15535
#14342
#3

Hi @danielpetri1
I'm not sure if I got this right. Does the "dark mode" changes the presentation color?

... and closes #4, right? I can't find any relation with #3.

Hi @pedrobmarin!
My bad. Yes, it closes #4.
This is what the "move notes to whiteboard" feature looks like in 2.6 at the moment:

While readable, the document's background has the same color as whiteboard's canvas (bluish grey instead of white).
So when we switch to dark mode, the background is black and the text is not readable:

So this PR adds a white background to the file itself.

And in dark mode:


Implement a merge bot

I'm wasting way too much time for merging PRs, mainly due to version bump.
Requirements

Set commit message.

Run a command once PR is merged.

This is for bumping the version and updating changelogs.
This should push back to the main branch.

Merge queue

It should auto-update the next approved PR after pushing version changes to the main branch.

(Maybe) Remove approval on CI failure

Tried alternatives

kodiak

I want to determine commit messages but seems like it only supports extracting it from PR.
But github does not support disapproving PR on message updates, so it does not meet my requirement.

Ah, I tried bors (and swc used it from start) but it also does not support running command after merging a PR.
I think I can create a shell script which extracts a commit message from my comment in the PR and run it using github action

after merging a PR

ah, yes that's probably not a thing from most of the tools I guess.

Unfortunately this needs waitlist, but https://www.repokitteh.io/ is one thing I was looking into as well.

Oh, I'll take a look, thanks!


Move WebCmdlets HTTPS tests to WebListener

Resolves #4719

Move badssl.com tests to local WebListener to remove reliance on external site for test.
Move HTTPS tests to their own context

@markekraus,
Thanks for having already signed the Contribution License Agreement. Your agreement was validated by Microsoft. We will now review your pull request.
Thanks,
Microsoft Pull Request Bot

AppVeyor failure is due to https://github.com/PowerShell/PowerShell/issues/4720

@markekraus Many thanks! I was happy with WebListener, now I am twice happy 😄


Accessibility: screen reader repeat timestamp multiple times

Version
4.8.0
Describe the bug
Some usability on screen reader:

Screen reader repeat timestamp multiple times
There is no clear association between the activity text, and its attachment

Steps to reproduce

Turn on Windows Narrator with either Chrome 80 or Edge 80+
Type "Hello" to the bot
Bot to send a hero card with buttons, in an activity with text

Expected behavior

Activity text should only be narrated once
When narrating the hero card, it should be "Activity text region. Yes button."

Additional context
Currently, there is a bug on NVDA 2019.3.1 (latest as of now) not working with Chrome 80 (latest as of now) with aria-live="polite". Please use Windows Narrator.
[Bug]

This is most likely a bug in Chrome / Edge. Please use Firefox.

It's a bug on Chromium, https://bugs.chromium.org/p/chromium/issues/detail?id=1067257.


[FEATURE] Add OPENAI_API_BASE to UI to enable usage oobabooga openai plugin

Describe the feature you'd like
oobabooga Text-generation UI has a plugin which emulates the openAI API. But in the UI of Flowise it is not possible to set the URL of OpenAI.
Setting the OPENAI_API_BASE via .env doesn't seem to work

Do you have the link to the plugin?

Do you have the link to the plugin?

It is build-in already: https://github.com/oobabooga/text-generation-webui/tree/main/extensions/openai

Instead of running oobabooga to serve your local LLM, you can use LocalAI instead. It gives you an OpenAI compatible API based on whatever model you choose to run. If you set up LocalAI from the repo here:
https://github.com/go-skynet/LocalAI
Then you can use the Existing ChatLocalAI node in flowise:
See example here https://github.com/go-skynet/LocalAI/tree/master/examples/flowise

@TheMasterFX with this PR merged - https://github.com/FlowiseAI/Flowise/pull/264 you can now specify a base path

Instead of running oobabooga to serve your local LLM, you can use LocalAI instead. It gives you an OpenAI compatible API based on whatever model you choose to run. If you set up LocalAI from the repo here:
https://github.com/go-skynet/LocalAI

As far as I can tell LocalAI doesn't seem to support GPTQ models (on GPU)

As far as I can tell LocalAI doesn't seem to support GPTQ models (on GPU)

Looking at the readme and build instructions on their github it looks like they have GPU support now, if still experiential, I'll try it out myself soon.

https://github.com/hwchase17/langchainjs/issues/1277

Start oobabooga with
call python server.py --auto-devices --chat --wbits 4 --groupsize 128 --api --listen --extension openai
Then enter the API url in the model in the UI http://<IP_ADDRESS>:5001/v1
However a LLMs might have different Keywords like "### Instruction:" or "User:"

However a LLMs might have different Keywords like "### Instruction:" or "User:"

Where do find these keywords?
Any template-suggestions for some known LLMs? 🙏🏽

However a LLMs might have different Keywords like "### Instruction:" or "User:"

Where do find these keywords? Any template-suggestions for some known LLMs? 🙏🏽

This might be a good source: https://github.com/oobabooga/text-generation-webui/tree/main/instruction-templates

This might be a good source: https://github.com/oobabooga/text-generation-webui/tree/main/instruction-templates

Thanks! Do you suggest any models + templates for flowise? I've tried a bunch of LLMs but none of them work as expected.

Instead of running oobabooga to serve your local LLM, you can use LocalAI instead. It gives you an OpenAI compatible API based on whatever model you choose to run. If you set up LocalAI from the repo here: https://github.com/go-skynet/LocalAI
Then you can use the Existing ChatLocalAI node in flowise: See example here https://github.com/go-skynet/LocalAI/tree/master/examples/flowise

I have a similar query.  I'm already using LM Studio as a local server, which gives me a load of models.  Why should it be necessary to download a completely new local server?  Also, if I want to host LM Studio on a completely different machine, I should only need to change the base_url.


Add link to Adobe documentation

A link to https://experienceleague.adobe.com/en/docs/experience-manager-core-components/using/developing/archetype/build-analyzer-maven-plugin would be helpful to have in the README for the maven plugin (https://github.com/adobe/aemanalyser-maven-plugin/blob/main/aemanalyser-maven-plugin/README.md)

it is there https://github.com/adobe/aemanalyser-maven-plugin/blob/main/aemanalyser-maven-plugin/README.md?plain=1#L162


The rotation is it possible

I see this project , and it work very well.
But i have a request, is it possible to rotate the camera.

if the mouse is on a corner (top left, top right, bot left , bot right)  of the screen the camera rotate ?
if the mouse drag on the outside of center of the screen, it rotate the screen,by going up or down?
-do you think it will be difficulte

Hi i does it myself. and add some modification to your code.
I have some question about some modification i bring to the cod.
Are you interested by the modificaiton. can i push it on the git ?


Cotton startup adds many seconds to a page render when it has to compile components

I have a web page with around 70 components.  The first time I visit the page it takes about 7800ms for the page to come up.  After that it takes about 140ms.  It appears the majority of the time for the first view is being spent in cotton.
For example, this section of the profiling alone is taking almost 4 seconds (the numbers are cumulative time):
6.852    /opt/render/project/src/.venv/lib/python3.11/site-packages/django_cotton/cotton_loader.py:31(get_contents)
6.849    /opt/render/project/src/.venv/lib/python3.11/site-packages/django_cotton/cotton_loader.py:115(process)
4.525    /opt/render/project/src/.venv/lib/python3.11/site-packages/django_cotton/cotton_loader.py:189(_compile_cotton_to_django)
4.298    /opt/render/project/src/.venv/lib/python3.11/site-packages/django_cotton/cotton_loader.py:254(_transform_components)
2.947    /opt/render/project/src/.venv/lib/python3.11/site-packages/django_cotton/cotton_loader.py:321(_make_soup)
I can probably live with this if this is a one-time delay at my site's startup but this just seems excessively long.  After the initial delay the pages do load quickly but every once in awhile there is the odd refresh where it takes several seconds again.  Not sure if this is a cotton delay or not though, I need to do some more profiling.   Any chance cotton could be invalidating the cache for some reason?

@ra-dave could you paste your settings file? TEMPLATES section and also how you are installing cotton (using django_cotton or django_cotton.apps.SimpleAppConfig in INSTALLED_APPS).
Cotton relies on Django's cached loader being present for optimal performance. Without it, cotton has it's own mechanism which is slightly less performant. Both caches should exists for the runtime of the Django app (it's reset between deployments / server restarts). I do have another hunch what it might be. If you could catch profiling for the slow loads that you mention exist after the initial load, that would be useful to determine the files causing that.

Using 'django_cotton' in INSTALLED_APPS.
TEMPLATES = [
    {
        "BACKEND": "django.template.backends.django.DjangoTemplates",
        'DIRS': [ BASE_DIR / 'templates', BASE_DIR / 'venv/Lib/site-packages/tailwind/templates', BASE_DIR / 'venv/Lib/site-packages/meta/templates' ],
        'APP_DIRS': False,
        "OPTIONS": {
            'context_processors': [
                'django.template.context_processors.request',
                'django.contrib.auth.context_processors.auth',
                'django.contrib.messages.context_processors.messages',
            ],
        }
    }
]

Here's a profile of a slow load after initial startup.   It does seem like cotton is recompiling:
   16    0.000    0.000    3.983    0.249 /opt/render/project/src/.venv/lib/python3.11/site-packages/django/template/loaders/cached.py:25(get_contents)
   16    0.000    0.000    3.983    0.249 /opt/render/project/src/.venv/lib/python3.11/site-packages/django_cotton/cotton_loader.py:31(get_contents)
    2    0.000    0.000    3.980    1.990 /opt/render/project/src/.venv/lib/python3.11/site-packages/django_cotton/cotton_loader.py:115(process)
    2    0.000    0.000    2.702    1.351 /opt/render/project/src/.venv/lib/python3.11/site-packages/django_cotton/cotton_loader.py:189(_compile_cotton_to_django)
221/2    0.025    0.000    2.535    1.268 /opt/render/project/src/.venv/lib/python3.11/site-packages/django_cotton/cotton_loader.py:254(_transform_components)
 1445    0.010    0.000    1.789    0.001 /opt/render/project/src/.venv/lib/python3.11/site-packages/django_cotton/cotton_loader.py:321(_make_soup)
 1445    0.026    0.000    1.756    0.001 /opt/render/project/src/.venv/lib/python3.11/site-packages/bs4/__init__.py:122(__init__)
 1445    0.007    0.000    1.656    0.001 /opt/render/project/src/.venv/lib/python3.11/site-packages/bs4/__init__.py:471(_feed)
 1445    0.006    0.000    1.618    0.001 /opt/render/project/src/.venv/lib/python3.11/site-packages/django_cotton/utils.py:88(feed)
 2890    0.142    0.000    1.594    0.001 /usr/local/lib/python3.11/html/parser.py:133(goahead)
 1445    0.003    0.000    1.594    0.001 /usr/local/lib/python3.11/html/parser.py:103(feed)
    2    0.003    0.001    1.255    0.627 /opt/render/project/src/.venv/lib/python3.11/site-packages/django_cotton/cotton_loader.py:200(_replace_placeholders_with_syntax)
  242    0.007    0.000    1.253    0.005 /usr/local/lib/python3.11/re/__init__.py:178(sub)
  343    1.158    0.003    1.159    0.003 {method 'sub' of 're.Pattern' objects}
 8075    0.150    0.000    0.927    0.000 /usr/local/lib/python3.11/html/parser.py:300(parse_starttag)
 8075    0.052    0.000    0.613    0.000 /opt/render/project/src/.venv/lib/python3.11/site-packages/django_cotton/utils.py:51(handle_starttag)

Oddly, this only seems to happen a few times and then it settles down and doesn't happen again until I restart the website.

The re-compile happening a few times is in-line with the multiple reloads I observed using https://github.com/adamchainz/django-browser-reload since I added django-cotton.
While I love this library and its abstraction, it really slows down development having to wait 30 seconds for every component change to settle until django-cotton settles.

@ra-dave @alfonsrv I run on several projects without performance issues but if you are able to provide a reproducible or a private copy of your project Id like to be able to take a closer look..

My components make extensive use of htmx, perhaps when compiling with that in the components really slows it down?  Still don't understand why the cache would be expiring though.

Using 'django_cotton' in INSTALLED_APPS.

@ra-dave can I ask what else you have installed? One thing I would look at if any other plugin has something that adjusts the loaders, maybe bypassing the cache loader changing loader config structure.

The re-compile happening a few times is in-line with the multiple reloads I observed using https://github.com/adamchainz/django-browser-reload since I added django-cotton.
While I love this library and its abstraction, it really slows down development having to wait 30 seconds for every component change to settle until django-cotton settles.

Hey. I am also experiencing this. My setup is django-cotton, django-tailwind, django-template-partials (using the loaders from the docs: https://django-cotton.com/docs/django-template-partials) and django-browser-reload, and it all runs on Docker. It seems to work perfectly fine when starting with fresh containers but things really do slow down after some* page refreshes/automatic refreshes from the browser-reload package. My guess would be that this is a dev-environment only thing.
*I haven't been able to identify the cause yet, I should have some more free time on the weekend, hopefully I can provide more info.

Thanks @g-nie, when you say “browser reload package” are you referring to the same one @alfonsrv uses?

Thanks @g-nie, when you say “browser reload package” are you referring to the same one @alfonsrv uses?

Yep this one

Ok here's a minimal-ish demo that hopefully illustrates the issue https://github.com/g-nie/cotton-reload

Using 'django_cotton' in INSTALLED_APPS.

@ra-dave can I ask what else you have installed? One thing I would look at if any other plugin has something that adjusts the loaders, maybe bypassing the cache loader changing loader config structure.

Here's my apps.  I have not used browser reload for some time due to other reasons.
INSTALLED_APPS = [
    'django.contrib.admin',
    'django.contrib.auth',
    'django.contrib.contenttypes',
    'django.contrib.sessions',
    'django.contrib.messages',
    'django.contrib.staticfiles',
    'django_htmx',
    'tailwind',
    'theme',
    'meta',
    'allauth',
    'allauth.account',
    'allauth.socialaccount',
    'a_home',
    # 'django_browser_reload',
    'django_cotton',
    'axes',
    # 'silk',
]

@g-nie thanks for the useful repro, I believe the culprit to be the get_dirs() in the loader. Since the results shouldn't change during runtime, caching this method should deal with it, locally for me it resolved the issue.
I will release this soon, hopefully you will be able to try it out and let me know for sure that it resolves the issue for you.

An update is released in 1.0.11. Please check it out and let me know if it resolves your issues.

@wrabit seems to work great now from my quick testing!
fyi with Python 3.8 – ImportError: cannot import name 'cache' from 'functools' (/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/functools.py)

It's also looking good here @wrabit 👌 Thanks for the super quick release!
Great job on cotton, it's such a useful tool.

I haven't profiled it yet but it's clearly much faster for me as well.  Thanks for such rapid support!

Good to hear @ra-dave. Interestingly enough, it's pushed the render benchmarks to new levels:
Average of 5 runs of 500 iterations each
---
Native Django {% for %} loop: 3.51 ms
Cotton equivalent: 2.89 ms
---
Native {% include %}: 2.98 ms
Cotton equivalent: 2.90 ms
---
Native {% block %} and {% extends %}: 9.29 ms
Cotton equivalent: 10.50 ms

(These are simple tests)
@alfonsrv changed @cache to the equivalent @lru_cache(max_size=None) to support python 3.8 in v1.0.12


passenger.handicaps snapshot, cannot evaluate expression

The ORM many to many connection between passenger and handicap objects is wrong(?):

File PassengerListDTO->getAccessQuery

the passenger grid view is not affected, however it isn't possible to display handicapsAsString
this error message is unfindable in the internet

Reason: $handicaps is in the watch list, however the object has not been evaluated (yet).
This is not a "real" error message.


Aqara zigbee window treatment

It is very difficult to review if this driver is correct or not as it is full of magic numbers, and strings.  I am not confident with the current level of documentation that we would ever be able to handle a support request about this device not working.

Changes look good to me. Thanks for making the requested updates.
To whoever does the merge, please do a Squash and merge

Test case is still failing with the same error, unfortunately.

Test case is still failing with the same error, unfortunately.

That's weird. Because Sending these two capablities(windowShade.closed() / windowShadeLevel.shadeLevel(0)) were removed from TC. So, logically the error logs should not be same.
And Could you share lua_libs which are same in your local environment for smooth test? We want to run the TC under same situation.


question about normal_loss and depth_loss

hi, thanks for your great work, did you test normal loss and depth loss based on mono depth and mono normal ? what's the results? I found that you load depth on normal in your codes.
if load_normal:             normal_path = image_path.replace("images", "normals")[:-4]+".npy"             normal = np.load(normal_path).astype(np.float32)             normal = (normal - 0.5) * 2.0         else:             normal = None
   ' if load_depth:
        # depth_path = image_path.replace("images", "monodepth")[:-4]+".npy"
        depth_path = image_path.replace("images", "metricdepth")[:-4]+".npy"
        depth = np.load(depth_path).astype(np.float32)
    else:
        depth = None`

Looking forward to your reply, thanks @kcheng1021

Yes, we have attempted to use monocular depth and normals directly, but this experiment was only tested on one Waymo scene. The monocular depth still require scale alignment with Gaussian-rendered depth for supervision. In cases where the initially rendered depth has significant errors, alignment can only be achieved using sparse depth from SFM (Structure from Motion). Additionally, direct monocular depth supervision cannot help grow correct Gaussians in incomplete regions and there is still a possibility of fitting depth at incorrect positions. Therefore, the direct monocular depth supervision has limited impact. Monocular normal supervision can provide good constraints for large planes. However, the monocular normals learned from the network may be oversmoothed. Additionally, it is important to consider how to select regions with good multi-view consistency.

Yes, we have attempted to use monocular depth and normals directly, but this experiment was only tested on one Waymo scene. The monocular depth still require scale alignment with Gaussian-rendered depth for supervision. In cases where the initially rendered depth has significant errors, alignment can only be achieved using sparse depth from SFM (Structure from Motion). Additionally, direct monocular depth supervision cannot help grow correct Gaussians in incomplete regions and there is still a possibility of fitting depth at incorrect positions. Therefore, the direct monocular depth supervision has limited impact. Monocular normal supervision can provide good constraints for large planes. However, the monocular normals learned from the network may be oversmoothed. Additionally, it is important to consider how to select regions with good multi-view consistency.

thanks for your reply!

Yes, we have attempted to use monocular depth and normals directly, but this experiment was only tested on one Waymo scene. The monocular depth still require scale alignment with Gaussian-rendered depth for supervision. In cases where the initially rendered depth has significant errors, alignment can only be achieved using sparse depth from SFM (Structure from Motion). Additionally, direct monocular depth supervision cannot help grow correct Gaussians in incomplete regions and there is still a possibility of fitting depth at incorrect positions. Therefore, the direct monocular depth supervision has limited impact. Monocular normal supervision can provide good constraints for large planes. However, the monocular normals learned from the network may be oversmoothed. Additionally, it is important to consider how to select regions with good multi-view consistency.

I'm also quite interested in this, considering patch match and NCC are already used in implemented for this method, I'm wondering if your team attempted using what the NeuRIS paper described for surface normals and region selection. Exactly how you described for ensuring good multiview consistency.


FIX: Object Copy to AWS

object copy to AWS S3

PR has been updated. Reviewers, please be cautious.

@ironman-machine try

Hello @nicolas2bert
"try": Success: Try build successfully launched on 'http://ci.ironmann.io/gh/scality/Integration/14902' with the following env. args:
{
    "SCALITY_INTEGRATION_BRANCH": "ultron/master",
    "REPO_NAME": "S3",
    "DEFAULT_BRANCH": "master",
    "SCALITY_S3_BRANCH": "fx/copy"
}

Hello @nicolas2bert
"ok": Failure: Unknown command

@ironman-machine ok

@ironman-machine try

Hello @nicolas2bert
"try": Success: Try build successfully launched on 'http://ci.ironmann.io/gh/scality/Integration/15014' with the following env. args:
{
    "SCALITY_INTEGRATION_BRANCH": "ultron/master",
    "REPO_NAME": "S3",
    "DEFAULT_BRANCH": "master",
    "SCALITY_S3_BRANCH": "fx/copy"
}

:sunny: :+1: circleCI test succeeded!

@ironman-machine r+

Hello @electrachong
"r+": Success

:hourglass: PR is now pending. CI build url: http://ci.ironmann.io/gh/scality/Integration/15018

:broken_heart: :umbrella: circleCI test failed.

@ironman-machine r+

Hello @nicolas2bert
"r+": Success

:hourglass: PR is now pending. CI build url: http://ci.ironmann.io/gh/scality/Integration/15019

:broken_heart: :hourglass: circleCI test timed out...

@ironman-machine r+

Hello @nicolas2bert
"r+": Success

:hourglass: PR is now pending. CI build url: http://ci.ironmann.io/gh/scality/Integration/15020

:sunny: :+1: circleCI test succeeded!


(BKR-321) Added LXC hypervisor support for beaker

Added LXC hypervisor for beaker. We have been using LXC from past 1 year have been really helpful in our environment. I had raised PR earlier somehow forgot to keep track of it

Can one of the admins verify this patch?

Hi @ashish1099! Sorry for the delay in getting back to you on this. In our conversation in #985, we determined that we'd rather not make people include more gems at this point than are needed, and are looking to find ways to downsize our footprint as well. For this reason, unless we find a workaround to only optionally install these gems, we're not looking to merge PRs like this one.
In that PR, we suggested that the submitter potentially maintain a fork of Beaker as THE LXC fork, and that if they'd like, we can link to them.  Would you like to maintain LXC support for the Beaker community by having us point to your fork as the one to use if you'd like to use the LXC hypervisor?

last comment still current

@kevpl I'm OK with that.

Thanks @ashish1099! I'll be submitting a small PR to update our docs later today. When I do this, I'll reference that one from here, and then close this PR.  Feel free to re-open this PR, or open or re-open a new ticket if you have any questions about this or anything involved with it.  Thanks!

Created #1136. Since that's the case, I'll close this PR.


Allow edits and deletes

To a message you send the bot

To clarify - this is through the telegram UI, correct?

no thru the bot

deletes aren't a valid webhook event :( so only edits


[Bible] Add BSB and LSB Translations

Extension
https://www.raycast.com/josmithua/bible
Description
The BSB is a modern public domain Bible translation.
The LSB is an update of the NASB 1995 (which is already included with the extension).
Who will benefit from this feature?
No response
Anything else?
No response

The LSB is available through Bible Gateway, which this extension uses.
The BSB is easily accessible through https://fetch.bible, e.g., https://collection.fetch.bible/bibles/eng_bsb/html/gen.json

Hi @knpwrs, I've submitted a PR to update the available bible versions from Bible Gateway,  which adds the LSB.
A lot more work would have to be done to support a new source like fetch.bible, so unfortunately the BSB is not an option right now.


Unhashing: invert the first negative term

So with always_signed=False the first will be always non-inverted.

Current coverage is 92.00% (diff: 83.33%)

Merging #20 into master will decrease coverage by 0.13%

@@             master        #20   diff @@
==========================================
  Files            12         12
  Lines           572        575     +3
  Methods           0          0
  Messages          0          0
  Branches         92         94     +2
==========================================
+ Hits            527        529     +2
  Misses           25         25
- Partials         20         21     +1

Diff Coverage
File Path

••••••••   83%
eli5/sklearn/unhashing.py

Powered by Codecov. Last update 467e03d...1bda1c5


update attributes with double quotes and without commas

I create pull request to update attributes to use double quotes and without commas. This solve single quotes problems and update clear syntax.

Hi @guumo,
Thank you for your contributions. The library core has been refactored and these issues addressed in the linked PR.
Closing in favour of #35.

BTW an option to use spaces instead of commas is being released in v3.0.0. Set useCommas to false.


Stream and display command output from server (e.g. tail of logs)?

I want to write a task to stream and display live logs from a server along the lines of this:
task('logs', function () {
run("tail -F -n 200 /usr/local/apache/logs/error_log");
});
Deployer seems to only show command output when the command finishes and if there was an error when I want this to display new log entries from stdout as they appear. Is there a standard way to make this work or even a quick hack for it like getting access to the SSH connection object and doing it myself? I had a look but the Server/Remote/PhpSecLib.php interface doesn't seem to give enough access to the output of the SSH command to do this.

As i know PhpSecLib and ssh2 extension does not provide this feature. I'm going to implement native ssh client in next release of Deployer. But now need to work at my other projects.

+1

I do not think deployer should do this. Watching apache logs is not a part of "deployment" process. The library should be able to show only the logs which is related to deployment. I mean, for me deployer is not server management tool.
To watch apache logs, you can define an alias to your .bashrc or .profile file like
alias prodlog='ssh user@production "tail -F -n 200 /usr/local/apache/logs/error_log"'
and just run prodlog command

Agree with @irfan

It's not so much for watching logs but when I do a deploy I want to do a quick manual check that the deploy didn't break anything and rollback if something went wrong. Forcing me to put the scripting somewhere else means I have to duplicate the scripting for connecting to servers which deployer takes the pain out of. The .bashrc approach also isn't great because it's not under source control and it's not shared between developers.
For comparison, Heroku's CLI tools has commands for deploying, viewing logs, rolling back and SSHing into servers and I find it greatly simplifies server management which is what I was hoping I could use deployer for.

Seems fair enough, I don't know what is the objective of Deployer. For me, these features that you mention might be another project which is using Deployer under the hood.

No watch in deployer.

@antonmedv what's the reason you've decided to never implement this? Output streaming would help when a script run on remote server outputs some data continuously during deploy.

@ged15 what do you mean by "outputs some data continuously during deploy"? Can you show an example?

One of our deployment scripts stops background processes just before switching the symlink. This script sends the stop command to the processes and waits for them to stop. While waiting, it continuously polls and streams output to the terminal like so:
 ** [out :: <IP_ADDRESS>] Waiting 2s for some_worker (11482 on @DC1)...
 ** [out :: <IP_ADDRESS>] Waiting 3s for some_worker (11482 on @DC1)...
 ** [out :: <IP_ADDRESS>] Waiting 4s for some_worker (11482 on @DC1)...
 ** [out :: <IP_ADDRESS>] Waiting 5s for some_worker (11482 on @DC1)...
 ** [out :: <IP_ADDRESS>] Waiting 6s for some_worker (11482 on @DC1)...
 ** [out :: <IP_ADDRESS>] Waiting 7s for some_worker (11482 on @DC1)...
...

Capistrano is able to output each line as it is output by the script and Deployr buffers the output until the script terminates and then outputs it all.

Okay, I think can implement this. PLease open an new issue and describe feature.
Btw, composer install outputs without buffering for me, and full log can be displayed.

@antonmedv my mistake, this works great for me too :) only blocker now is for me now is https://github.com/deployphp/deployer/issues/1419


Request: site  cloner

It would be cool if you could add a site cloner that would generate the phishing page.
Or can you add a quick wiki on how to create them

https://github.com/An0nUD4Y/SocialFish try this

They don't have a site cloner

@Darkcast Site cloner is useless now cuz you can't capture credentials if username and password fields are not on the same page just like in social engineering toolkit(set).Many sites are now accepting username and password on different pages lime yahoo,live etc

yes I totally understand that, but if you can get a cloner it would be simple just to mod the html to capture the credentials, right now I am using bootstrap to mimic the sites I want to do pen-testing campaigns. but I do understand that would be some extra coding on your end so it was just a suggestion. btw I made a apple login if your interested

@Darkcast Yes sure just submit your PR here.


BUG: fix annualization of alpha

For #59, annualize alpha correctly

This looks right. But would hope that some tests catch this we need to change.

@twiecki just updated test_stats.py to fix the failures - mind taking a quick look at those as well? Mostly just updating numbers

LGTM. We should probably alert others to this bugfix.

FYI I have walked Vikram's analysis of where this code is used to the PM team, Dan and Rich. We are good to go, they will be adding a forum post to explain the change.

I agree that a forum announcement is appropriate and will be a non issue.  "we love open source software, our calculations are all out there, if you see any mistakes we're all better off when we fix them."

LGTM

Can we merge this?

We chose to wait for when we have the bandwidth to write a blog post announcing the change. Will follow up on that today

I think there is still a bug here, as the failing tests show. Seems like it always returns 0 or nan?

Thanks @gmanoim-quantopian !


FancyZones - Set a default zone layout for different resolutions or monitors

Description of the new feature / enhancement
Set a default zone layout for different resolutions or monitors.
Scenario when this would be used?
When switching between different monitors. My specific use case is at work I have an layout for my 49" 5120x1440 screen and at home I have a different layout for my 34" 3440x1440 screen.
Supporting information
No response

FancyZones should remember the layouts on the different monitors. Is it not working for you? /needinfo

I didnt know it already had the feature. It hasnt worked for me before but I a clean install to v0.75.1 and now its working.


Update sfb-client-updates.md

Adding April release for 2016 and 2015 MSI.  Fixing the Mac section to just have a link off to the release notes elsewhere.

@jambirk Hi James, could you please check this PR if correct, please merge. Thanks.

@scanum  FYI @PhillipGarding is the primary SME
Phillip,  your pull requests will probably go through faster if you @ mention me in the comments for the PR. It makes sure I get a notification and that I can distinguish it as something that requires my attention. GH sends a torrent of FYI emails.


Issue1055

Updates incorporated based on review comments

Updates incorporated based on review comments

Thanks for the update @jaydeepparekh1311 ... I have approved this now

@jaydeepparekh1311 @miklish Do you have further changes to the 1.6.x branch? if not, I will start the release process. Thanks.

No, we're good Steve... please proceed. Thanks


Fix model names with underscores

Fixes https://github.com/beyondcode/laravel-er-diagram-generator/issues/40
The generator was breaking if a model had underscores on it's name

remove - from node name

will remove errors when building a graph but it will break relations to other models.
ModelRelation.php must also be changed
    public function getModelNodeName()
    {
        return str_replace('-', '', str_slug($this->model));
    }


Improve Bitnami information for Kong in Azure

Summary
Improve Bitnami information for Azure Kong Single-VM and Cluster solutions.

Nice tune-up, thanks @beltran-rubo
So, given that this page is now all about Bitnami's solutions, can I suggest you move it from "Made by: Tom Kerkhove" to "Made by: Bitnami"?

@tomkerkhove would you be OK with that?

The idea for the Azure page is to have one central landing page for Azure.
My suggestion would be to keep it like this or create a Bitnami page (ie Running Kong on Azure with Bitnami) and add a pointer here.
Would that make sense?

We are fine with any of those suggestions, @coopr let us know the best approach for you.

To be clear - I'm not trying to keep the content under my own name, I just want to provide an umbrella for all things Azure with pointers to resources to run Kong on Azure.
Moving this content to a dedicated page is fine for me as it makes perfect sense - I'd prefer to keep my page in.

Right now, given the structure of https://docs.konghq.com/hub/, we need to have each Hub listing that is maintained by a different party on a different page. Thus, if @tomkerkhove maintains the Azure + Kong "integration" that is documented on https://docs.konghq.com/hub/tomkerkhove/microsoft_azure_container_instances/ , and if @beltran-rubo and Bitnami maintain the "integration" that is documented on https://docs.konghq.com/hub/tomkerkhove/microsoft_azure/, it would make sense for the former page to be "supported" and maintained by @tomkerkhove and the latter page to be "supported" and maintained by Bitnami staff.
Does that make sense to all of you?
Someday, yes, I agree that Kong Inc. would like to have one or more tiles on https://konghq.com/install/ pointing to Azure installation options. We had those briefly, but there were some questions internally about mixing Kong-supported and Community-supported options on https://konghq.com/install/ so we took them down until we work out those questions.
Until then, let's focus on making these two Azure-related pages on https://docs.konghq.com/hub/ better.

I agree @coopr 	but the reason why I have https://docs.konghq.com/hub/tomkerkhove/microsoft_azure/ is to act as a landing page where you can find everything to run Kong on Azure. Currently, it has 2 Bitnami templates in Deploying Kong via the Azure Marketplace but (hopefully) there will be more in the future.
That's why I would suggest to have:

ACI - https://docs.konghq.com/hub/tomkerkhove/microsoft_azure_container_instances/
Kong with Bitnami - https://docs.konghq.com/hub/bitnami/microsoft_azure/
Azure in general - https://docs.konghq.com/hub/tomkerkhove/microsoft_azure/

In that respect I would do a follow-up PR to move Running PostgreSQL on Azure with Azure Database for PostgreSQL & Running Cassandra on Azure with Azure Cosmos Db from https://docs.konghq.com/hub/tomkerkhove/microsoft_azure_container_instances/ to https://docs.konghq.com/hub/tomkerkhove/microsoft_azure/ as I'll need this for other services such as Service Fabric Mesh.

Ah, ok, let's try that @tomkerkhove ! Thanks for your contributions on this.

@coopr 	Awesome, I've created a seperate PR for this (#1049) but it can wait until this one has been merged in.
@beltran-rubo Feel free to let me know if you want me to jump in and help split these pages.

Lets close this one and work in your PR. Could you please create the new schema? I will be happy to fill the Bitnami ones.