ReportingUpdates-chrisda to Master

Docs Build status updates of commit d56c319:
:clock10: Full build: the average full build time is 17 min(s) 41 sec(s), this is based on the last 1000 build(s) for this repository.

Docs Build status updates of commit d56c319:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

exchange/exchange-ps/exchange/Get-DlpDetectionsReport.md
:white_check_mark:Succeeded
View (exchange-ps)

exchange/exchange-ps/exchange/Get-MailTrafficATPReport.md
:white_check_mark:Succeeded
View (exchange-ps)

exchange/exchange-ps/exchange/Get-MailTrafficPolicyReport.md
:white_check_mark:Succeeded
View (exchange-ps)

exchange/exchange-ps/exchange/Get-MailTrafficReport.md
:white_check_mark:Succeeded
View (exchange-ps)

exchange/exchange-ps/exchange/Get-MailTrafficTopReport.md
:white_check_mark:Succeeded
View (exchange-ps)

exchange/exchange-ps/exchange/Get-SafeLinksAggregateReport.md
:white_check_mark:Succeeded
View (exchange-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel

Docs Build status updates of commit 4094440:
:clock10: Full build: the average full build time is 17 min(s) 41 sec(s), this is based on the last 1000 build(s) for this repository.

Docs Build status updates of commit 4094440:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

exchange/exchange-ps/exchange/Get-DlpDetectionsReport.md
:white_check_mark:Succeeded
View (exchange-ps)

exchange/exchange-ps/exchange/Get-MailTrafficATPReport.md
:white_check_mark:Succeeded
View (exchange-ps)

exchange/exchange-ps/exchange/Get-MailTrafficPolicyReport.md
:white_check_mark:Succeeded
View (exchange-ps)

exchange/exchange-ps/exchange/Get-MailTrafficReport.md
:white_check_mark:Succeeded
View (exchange-ps)

exchange/exchange-ps/exchange/Get-MailTrafficTopReport.md
:white_check_mark:Succeeded
View (exchange-ps)

exchange/exchange-ps/exchange/Get-SafeLinksAggregateReport.md
:white_check_mark:Succeeded
View (exchange-ps)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel


[Mirrored Strategy] You dataset iterator ran out of data; interrupting training.

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow):YES
OS Platform and Distribution (e.g., Linux Ubuntu 16.04):Ubuntu 18.04
TensorFlow installed from (source or binary):Pip tensorflow-gpu 2.0 beta1
TensorFlow version (use command below):2.0 beta1
Python version:3.7
GPU model and memory:Titan RTX x 2 (2 x 24GB) / P100 x 2 (2 x 16GB)

Error in keras.Model.fit.
When using the mirroredstrategy with tensorflow dataset in both training and validation.
Single GPU card works fine, whether using the mirroredstertegy or not. (When using the mirroredstertegy, set the devices = /gpu:0). This problem only occurs when using multiple gpu cards.
The error displayed:
[training_arrays.py 325] Your dataset iterator ran out of data; interrupting training. Make sure that your iterator can geretate at least "validation_steps * epochs" batches.
Currently the only worked solutation for me is manully set the "validation_steps" in keras.Model.fit.
Tensorflow dataset repeat or/and take, will not work. By setting the validation batch size to 2 (1 for each GPU) also does not work
Simliar issues in here https://github.com/tensorflow/tensorflow/issues/25254, but closed

As mentioned in #25254 . The offical example code is not worked either.

Keras should be able to figure out validation_steps.  (cc @omalleyt12 )
Could you please share the code so that we have more complete details of this case while we are looking at it?  Thanks.

Keras should be able to figure out validation_steps. (cc @omalleyt12 )
Could you please share the code so that we have more complete details of this case while we are looking at it? Thanks.

When I do not pass the validations_steps:
Without Mirroed Strategy : Work
With Mirroed Strategy, Single Card : Work
With Mirroed Strategy, Multiple Cards with device = /gpu:0 : work
With Mirroed Strategy, Multiple Cards with device = /gpu:1 : work
With Mirroed Strategy, Multiple Cards : Error

I think this maybe the keras does not consider when the numbers of val data is odd.

same here here

I have get the same problem

Same issue

@edwardyehuang Can you please test it against latest tf 2.0 nightly build. Thanks!
pip install tf-nightly-2.0-preview

@edwardyehuang Is this still an issue? Can you check with TF2.0 and/or tf-nightly and let us know whether the issue persists with latest TF version. Thanks!

@edwardyehuang Is this still an issue? If not, please close the issue. Thank!

Is this really fixed? With tf 2.0.0 + keras.fit + tf.dataset for validation data + multi-gpu, i'm having the same issue.

FIxed confirmed in 2.0 stable version

what's the fix ? want to use it in 1.14

I found it cannot estimate the data from tfrecord

Or, it can, but will print some ugly warning message. The program will not stop

try:
%tensorflow_version 1.x # enable TF 1.x in Colab
except Exception:
pass
print(tf.version)
#just try to not to use TF 2.x


[NetworkControl] DHCP server now properly set <IP_ADDRESS> as source

According to rfc2131 every DHCP packet before ACK should have <IP_ADDRESS>
set as source in IP frame. It seems that some routers are very strict
about it. However to do that reliably, DHCP socket had to be
reimplemented as raw AF_POCKET type

https://jenkins.code.rdkcentral.com/job/github-triggered/2143/ started

https://jenkins.code.rdkcentral.com/job/github-triggered/2150/ started


FIX [nmq_mqtt] conle conn_param for fixing https://github.com/emqx…

please check along with https://github.com/emqx/nanomq/pull/578


slack integration test

Nothing useful. Just a test.

@atomicsamurai did you want to add specific tests for the slack integration or was this an action item that we can close now that we have slack integration active for the new repos?


ARROW-5685: [Packaging][deb] Add support for Apache Arrow Datasets

@ursabot crossbow package -g linux

@ursabot crossbow package -g linux

@kszucs Can we use https://travis-ci.org/ursa-labs/crossbow/builds/548880402 instead of https://travis-ci.org/ursa-labs/crossbow/branches for debian-stretch status badge link?

Does this make sense? The datasets library is an empty shell for now. @wesm
(also, what is the reason for making it a separate DLL?)

@pitrou among other things, I want to move the Parquet<->Arrow implementation from src/parquet/arrow to src/arrow/dataset/parquet. This means that libarrow_dataset needs to link to both libarrow and libparquet

@ursabot crossbow package centos-6

This is not needed for now.
I want to suppress warnings in .deb build process. .deb build process reports missing files that are installed but not included in any .deb.

+1
All packages are buildable.


What's the performance’s difference between chat-7b and chat-7b-8k?

E valuation results show these two models are both competitive. Feel  free  to  try  OpenCompass  for  evaluating  8k version. We will update evaluation results of 8k version recently.


Install fails with subtle errors when tmp is mounted noexec

Hi.
Had difficulties getting pynitrokey to install in a virtual environment (Python 3.11, with cython installed):
Collecting pyyaml>=3.12
  Using cached PyYAML-5.4.1.tar.gz (175 kB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... error
  error: subprocess-exited-with-error

  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [8 lines of output]
      /tmp/pip-build-env-fk5k86wk/overlay/lib/python3.11/site-packages/setuptools/config/setupcfg.py:508: SetuptoolsDeprecationWarning: The license_file parameter is deprecated, use license_files instead.
        warnings.warn(msg, warning_class)
      running egg_info
      writing lib3/PyYAML.egg-info/PKG-INFO
      writing dependency_links to lib3/PyYAML.egg-info/dependency_links.txt
      writing top-level names to lib3/PyYAML.egg-info/top_level.txt
      failed to import Cython: /tmp/pip-build-env-fk5k86wk/overlay/lib/python3.11/site-packages/Cython/Compiler/Scanning.cpython-311-x86_64-linux-gnu.so: failed to map segment from shared object
      error: Cython does not appear to be installed
      [end of output]

It turns out that this is due to /tmp being mounted noexec. Pointing TEMP elsewhere for the install, makes it run smoothly. This might save someone else a bit of time :)

Thank you for the tip! Worth adding to the doc.
For me installation on Python 3.11 does not work at all due to the dependency still requiring 3.10. It's interesting it was working for you - must be a recent change.

I noticed this is also the case, if you try to run the static versions (nitropy-xxxx-x64-linux-binary) from the download area. The /tmp mount must be "exec". Otherwise you get "error while loading shared libraries: xxxxx: failed to map segment from shared object".

The official way to install should be pipx haven't seen similar issues since - closing this issue - feel free to create a new one or re-open, if you still encounter this issue


Fix wrong class in sample

Contributor Checklist

[x] Review Contribution Guidelines
[x] Make sure that all commits are signed off to indicate that you agree to the terms of Developer Certificate of Origin.
[x] Make sure all contributed code can be distributed under the terms of the Apache License 2.0, e.g. the code was written by yourself or the original code is licensed under a license compatible to Apache License 2.0.
[x] Check "Allow edit from maintainers" option in pull request so that additional changes can be pushed by Gradle team
n/a Provide integration tests (under <subproject>/src/integTest) to verify changes from a user perspective
n/a Provide unit tests (under <subproject>/src/test) to verify logic
[x] Update User Guide, DSL Reference, and Javadoc for public-facing changes
[x] Ensure that tests pass sanity check: ./gradlew sanityCheck
[x] Ensure that tests pass locally: ./gradlew <changed-subproject>:quickTest

Gradle Core Team Checklist

[ ] Verify design and implementation
[ ] Verify test coverage and CI build status
[ ] Verify documentation
[ ] Recognize contributor in release notes

Thanks for catching and taking the time to fix this.
Closing as #17574 includes this fix and another.


Fixing VDF prover for high difficulty

VDFs with difficulty higher than INT_MAX<PHONE_NUMBER>) fail even if the difficulty is set as a double. This is because of a int loop on the difficulty in the prover_slow.h file.
Linked to issue #125

Closing this since https://github.com/Chia-Network/chiavdf/pull/132 got merged in. Thank you for the contribution @rrtoledo. I'll be sure to give you recognition in the release notes.


Custom feature will be lost after run build --with xxx

I also used this way, why does the website keep loading


Camera resource not released properly

I'm having problem with indi_pylibcamera driver after it was not properly disconected.
It looks like that some process is still using camera.
 Nothing helps. Only reboot or kill process python3 solves the problem.
Here is output of libcamera-hello after indi_pylibcamera not disconected properly.
simon@raspberrypi:~ $ killall -9 indiserver
simon@raspberrypi:~ $ libcamera-hello -t0
Made X/EGL preview window
[23:31:26.386909776] [178147]  INFO Camera camera_manager.cpp:299 libcamera v0.0.4+22-923f5d70
[23:31:26.460912891] [178148]  INFO RPI raspberrypi.cpp:1476 Registered camera /base/soc/i2c0mux/i2c@1/imx477@1a to Unicam device /dev/media4 and ISP device /dev/media0
[23:31:26.461703565] [178147]  INFO Camera camera.cpp:841 Pipeline handler in use by another process
ERROR: *** failed to acquire camera /base/soc/i2c0mux/i2c@1/imx477@1a ***
simon@raspberrypi:~ $ libcamera-hello -t0
Made X/EGL preview window
[23:35:40.759566079] [178679]  INFO Camera camera_manager.cpp:299 libcamera v0.0.4+22-923f5d70
[23:35:40.807548553] [178683]  INFO RPI raspberrypi.cpp:1476 Registered camera /base/soc/i2c0mux/i2c@1/imx477@1a to Unicam device /dev/media4 and ISP device /dev/media0
[23:35:40.807800031] [178679]  INFO Camera camera.cpp:841 Pipeline handler in use by another process
ERROR: *** failed to acquire camera /base/soc/i2c0mux/i2c@1/imx477@1a ***
simon@raspberrypi:~ $ lsof /dev/video0
COMMAND    PID  USER   FD   TYPE DEVICE SIZE/OFF NODE NAME
python3 173840 simon   15u   CHR  81,14      0t0  483 /dev/video0
simon@raspberrypi:~ $ lsof /dev/media0
COMMAND    PID  USER   FD   TYPE DEVICE SIZE/OFF NODE NAME
python3 173840 simon   12uW  CHR  238,0      0t0  221 /dev/media0
simon@raspberrypi:~ $

It looks like python3 process is still using camera after drver crashed.
After I kill that process manually everithing is working again. Ekos connect properly.
simon@raspberrypi:~ $ kill -9 173840
simon@raspberrypi:~ $ libcamera-hello -t0
Made X/EGL preview window
[23:43:14.416553017] [179629]  INFO Camera camera_manager.cpp:299 libcamera v0.0.4+22-923f5d70
[23:43:14.477593590] [179630]  INFO RPI raspberrypi.cpp:1476 Registered camera /base/soc/i2c0mux/i2c@1/imx477@1a to Unicam device /dev/media4 and ISP device /dev/media0
[23:43:14.478633428] [179629]  INFO Camera camera.cpp:1028 configuring streams: (0) 2028x1520-YUV420
[23:43:14.479021997] [179630]  INFO RPI raspberrypi.cpp:851 Sensor: /base/soc/i2c0mux/i2c@1/imx477@1a - Selected sensor format: 2028x1520-SBGGR12_1X12 - Selected unicam format: 2028x1520-pBCC
simon@raspberrypi:~ $

Is it possible to somehow automate this step? Maybe you could remember that python3 processid on driver startup and write it down to some file. On next startup you check that file and if it containt processid you kill it?

This is likely the effect I described in the README.md in section "Error when restarting indiserver". The INDI server starts the driver as a sub-process and when the server crashes the sub-process does not get terminated.
There can only be one indi_pylibcamera.py driver running on the machine. I will implement something that kills an existing driver at startup. I just need to find out how to do this in Python (without killing itself). That will certainly not work when the older driver was started by a different user, but that is not a normal use-case.

That would be great! Indi web manager automatically restart driver when necessary. It would greatly improved UX and robustness if you can figure that out.

I implemented the killing of an old driver in branch https://github.com/scriptorron/indi_pylibcamera/tree/35-camera-resource-not-released-properly
It worked in my tests. But I found another issue:  when you disconnect a camera and connect it again the following error comes up:
RuntimeError: Camera __init__ sequence did not complete.

It is reproducible by clicking in the driver "Connect", "Disconnect" and "Connect". This can also happen when you kill a driver which had a camera connected, start a new driver and connect the camera in the new driver. After a while it works. It seems, the libcamera stack still has a resource locked until a timeout occurs or a processing finished. I will try to find a solution.

I fixed the reconnect issue in the mentioned branch. It was easier than expected. Next days I will do more tests before I merge it to the master branch.

That's really great to hear that you managed to solve that problem. It should really graatly improve stability and robustness of imaging. Thumbs up!

Today I also added code to close camera when getting killed by SIGINT or SIGTERM. I will merge to main branch. Maybe you can give ma feedback if it works in your environment. Thanks.

Wow! Latest version feels amazing! Changing different INDI clients feels great. There is no more issuse if user don't disconect properly. Driver just works! You did amazing job! Driver is now really robust!

Thank you for your kind words. You have a big part on it: you test it in an environment I do not have. Thank you for your help!

I'm really glad that I can help.


[Website] - Make the Layer5 a clickable link

Description
Currently, Layer5 logo in this section is not a clickable link.
Expected Behavior
Add a link to the Layer5 logo directing to the Layer5.io website
Screenshots/Logs

Environment

Host OS: Mac Linux Windows
Meshery Server Version: stable-v
Meshery Client Version: stable-v
Platform: Docker or Kubernetes

Contributor Resources:

(Contributing Docs](https://docs.meshery.io/project/contributing)

Hello @Anita-ihuman, I would like to work on this issue as I myself am a first-timer

here you go! @shahkushal38

Closed as it was fixed in PR #499

@leecalcote Could you please transfer this issue to meshery.io repository? 👀

Hey @adithyaakrishna, doesn't an issue get closed automatically after a linked PR is merged?

Yes, it does but the issue is in one repository and the PR in another 😂
This issue needs to be transferred to meshery.io repo

😂😂😂😂ohh okay

Oooppss😅
Sure I will


Set Atomic visibility

Set Fedora Atomic visibility to public.

Matthew McConaughey voices Alright, alright, alright.


Hypothesis

Added functions to t statistics functions for multiple regression, as well as tests for such things. Updated script file for t statistics to reflect multiple options for convolution function.
@hiroto-udagawa

Damn, I keep being sloppy, this pull request contains updates for the glm stuff as well, can't push until the glm stuff is oked. Sorry.
@janewliang

I think this is okay! We seem to have some merge conflicts, though.

@janewliang look, I fixed the conflict :). @hiroto-udagawa is this useful now?

Good job!

i think its good to have!


Update docs

Made some minor changes in docs to make it more grammatically accurate and for better readability

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

@FarukhS52 Thank you for your contribution


[Doubt] Extracting state and dispatch in a single line

I'm implementing your library along with using 'useReducer'. I'm a little curious.
Why this:
const name = useContextSelector(UserContext, (v) => v[0].name);   const userDispatch = useContextSelector(UserContext, (v) => v[1]);
It is not the same as this other thing:
const [name, userDispatch] = useContextSelector(UserContext, v => [v[0].name, v[1]]);
If I implement the second, it updates all the components connected to the Context.
This is my UserContext:
`
import React, { useReducer, useState } from "react";
import PropTypes from 'prop-types';
import { createContext } from "use-context-selector";
const UserActions = {
SET_NAME: "SET_NAME",
SET_AGE: "ADD_AGE",
}
const initialState = {
name: "John Doe",
age: 18,
}
const reducer = (state, action) => {
switch (action.type) {
case UserActions.SET_NAME:
return {
...state,
name: action.payload
}
case UserActions.SET_AGE:
return {
...state,
age: action.payload
}
default:
return state;
}
}
const UserContext = createContext(null);
const UserContextProvider = ({ children }) => {
const [state, userDispatch] = useReducer(reducer, initialState);
return <UserContext.Provider value={[state, userDispatch]}> {children} </UserContext.Provider>
};
UserContextProvider.propTypes = {
children: PropTypes.node.isRequired,
};
export { UserContext, UserContextProvider, UserActions };
`

sorry


OSError: [WinError 10048] Only one usage of each socket address (protocol/networ k address/port) is normally permitted

Hello. There is a small problem with your script or with my knowledge of Python.
OSError: [WinError 10048] Only one usage of each socket address (protocol/networ
k address/port) is normally permitted
I use the standard example for ARS
It gives this error. Can you help me?

Hi,
It sounds like you already have something listening on that port. You might want to run netstat to show all listening UDP ports and disable/stop the offending service.
Nat

If you are using MNIS likely it is listening on the same port. The "OSError: [WinError 10048] Only one usage of each socket address (protocol/network address/port) is normally permitted" error is an error your OS is kicking back because you can only listen on one address:port combination at once. Either this library is listening twice which I sorta doubt since I use it in my own apps, or there's already an app listening on your local computer with that port (which is likely, since you mentioned you run MNIS). Try on a totally blank computer/raspberry pi or a VM. Also, ARS is used for a lot of stuff with trbos, especially RMDP, so there may be more than just one app contending for use of that port.


[Feature] 💥 Upgrade to webpack 4 🎉👍

I'm submitting a ...
[ ] bug report
[X] feature request
[ ] question about the decisions made in the repository

Do you want to request a feature or report a bug?
Feature: Upgrade to webpack 4

What is the current behavior?
Currently, it is Webpack 3

What is the expected behavior?
Use Webpack 4 as it contains big improvements

What is the motivation / use case for changing the behavior?
As you can see the big features and changes in release notes: https://github.com/webpack/webpack/releases/tag/v4.0.0

🎉 💃

Looks like will have to wait until html-webpack-plugin is upgraded. Might have to upgrade some others as well, but this one is crucial.

https://github.com/jantimon/html-webpack-plugin/issues/860
Looks like they are already working on it. Maybe you can test further with the alternative: npm install -D webpack-contrib/html-webpack-plugin

It fails to install for me. Runs some specs and throws lots of exceptions. May be because we're using corporate npm registry and it doesn't have an access to webpack-contrib/ .

There are a couple of packages which needs patches. https://github.com/szrenwei/inline-manifest-webpack-plugin/issues/10 and https://github.com/numical/script-ext-html-webpack-plugin/issues/41. Patches are obvious and I used patch-package for now.

FYI, Angular CLI has been updated for webpack 4.0

@sherlock1982 we can use webpack-inline-manifest-plugin instead of inline-manifest-webpack-plugin
And script-ext-html-webpack-plugin version 2 is supporting webpack 4

I've did a quick and dirty upgrade to the latest version of webpack (4.1.1). It's working, the build is much faster, but unfortunately I had to disable html-elements-plugin which exists as part of this repo (angular-starter\config\html-elements-plugin\index.js) since it's not compatible and I'm lacking both knowledge and time to upgrade it. My code changes are uploaded into the branch >> here <<. For now I'm not going to create PR for it. If someone is willing to look into it, please feel free.

@lanovoy why you removed the CommonsChunkPlugin?
https://github.com/gdi2290/angular-starter/compare/feature/migrate-to-webpack4#diff-f737fedb5357468044db2dbe98eb0218L189
Is there any reason? I think chunks are helpful, isn't?
for html-elements-plugin I think it can be a PR for it, sounds the Author is active so we can get this running once it is done, and maybe some people using it.
I'm not sure why you removed the ModuleConcatenationPlugin as well, I see commit says deprecated plugin, which one is? because I don't see the source of this info in their doc, is it NamedModulesPlugin or ModuleConcatenationPlugin.
There are my notes currently.

https://medium.com/webpack/webpack-4-code-splitting-chunk-graph-and-the-splitchunks-optimization-be739a861366

@kuhnroyal thanks, but at least add some context to your link, like a TL;DR version.

Yes, those plug-ins were removed as they are listed as not needed for
webpack anymore. Webpack does the same as they do out of the box now.
вс, 18 марта 2018 г., 15:39 Al-Mothafar Al-Hasan<EMAIL_ADDRESS>
@kuhnroyal https://github.com/kuhnroyal thanks, but at least add some
context to your link, like a TL;DR version.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/gdi2290/angular-starter/issues/1973#issuecomment-374004414,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AFWb43vfihD5g3_aR9qPt7abYOAOva3pks5tfnGXgaJpZM4SSSSW
.

ngtools 1.10.0 (and 1.10.2) are technically not compatible with the Webpack
4, but you may be right and it's just a cosmetic incompatibility... Feel
free to verify yourself.
вс, 18 марта 2018 г., 15:54 Maksym Lanovyi<EMAIL_ADDRESS>
Yes, those plug-ins were removed as they are listed as not needed for
webpack anymore. Webpack does the same as they do out of the box now.
вс, 18 марта 2018 г., 15:39 Al-Mothafar Al-Hasan<EMAIL_ADDRESS>
:

@kuhnroyal https://github.com/kuhnroyal thanks, but at least add some
context to your link, like a TL;DR version.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/gdi2290/angular-starter/issues/1973#issuecomment-374004414,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AFWb43vfihD5g3_aR9qPt7abYOAOva3pks5tfnGXgaJpZM4SSSSW
.

@lanovoy I'll do verify later for sure, I just did code review and was looking for clarifications before I reinvent the wheel, sadly not have enough time to do that by myself, so I appreciate your efforts.
If I have fixes I'll do that on the branch that you created.

Awesome! Thank you
вс, 18 марта 2018 г., 16:58 Al-Mothafar Al-Hasan<EMAIL_ADDRESS>
@lanovoy https://github.com/lanovoy I'll do verify later for sure, I
just did code review and was looking for clarifications before I reinvent
the wheel, sadly not have enough time to do that by myself, so I appreciate
your efforts.
If I have fixes I'll do that on the branch that you created.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/gdi2290/angular-starter/issues/1973#issuecomment-374010428,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AFWb409M3mhnEyy0IwD4DdmpIwn_DrT0ks5tfoQdgaJpZM4SSSSW
.

One another outstanding issue with the webpack 4 conversion in the branch created by me, is that there is some dependency to webpack 3.x still somewhere (likely in the plugins npm packages). After npm install you will find both webpack versions in the node_modules.

@lanovoy let me look into it. I am not expert but I can try.

@lanovoy  I checked your code. use "@angular/cli": "next", instead of "@angular/cli": "^1.7.3", becasue "@angular/cli": "^1.7.3", version has dependency of webpack 3

I was thinking about postponing this, until Angular 6 is released it should be on 4th of April
https://github.com/angular/angular/blob/master/docs/RELEASE_SCHEDULE.md

I agree, it would be the best to wait until Angular 6 release. I will
create an issue to upgrade shipped with this repo plug-in, tho...
пн, 19 марта 2018 г., 15:38 Al-Mothafar Al-Hasan<EMAIL_ADDRESS>
I was thinking about postponing this, until Angular 6 is released it
should be on 4th of April
https://github.com/angular/angular/blob/master/docs/RELEASE_SCHEDULE.md
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/gdi2290/angular-starter/issues/1973#issuecomment-374234724,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AFWb404QX0TDjuFhNjEZycp65g6CS0rwks5tf8LwgaJpZM4SSSSW
.

#1995
Additionally in my branch there is a problem with the karma test runner it seems so.

I agree with waiting for angular 6 release decision. I will try to update html-elements-plugin I don't know how to update but will give a try.

@lanovoy have you checked HMR reload after code updating? Because after CommonsChunkPlugin removing it was broken to me.

@lanovoy you're using jasmine-core 3.1.0 which has an issue with current zone.js. This is explained here. You could use 2.9.1 or wait until new zone.js release.

@Yizhachok Nope, didn't test HMR. You can clone from my branch and verify yourself, tho.
In any case HMR is not really working with current setup (pre-upgrade to webpack4) - it's doing whole page reload instead of hot swapping changed parts...

@sherlock1982 Thanks. I suppose we're going to wait for Angular 6 release in any case, so hopefully jasmine-core will be updated by that time as well...

Heads up, there are few issues with current starter test webpack + ts config using packages webpack@4 + typescript @2.6.2 + awesome-typescript-loader@5. More info here

Looks like Angular 6 release is postponed again. RC3 just got released. Many really sweet features with Angular 6, so upgrading to it should be pretty much a priority for this starter project.

Bump, Angular 6.0 is out.

@konuch  We were waiting for angular 6 release. Yes we need to test our migrate-to-webpack4 branch before we push to master.
I will start working on SSR implementation this week end.

@govi2010 I did a quick skim in migrate-to-webpack4 and didn't see anything for SSR. Is that coming soon? We're looking at SSR soon and I want to do it the 'correct` way. Thanks!

It was merged into master. Thanks for the help people! PR for reference https://github.com/gdi2290/angular-starter/pull/2019


Added user orders to account page.

Added a couple little comments - good to merge this when they're in!

plz rebase also and tag the issue - happy to talk you through the process on gitter if you need a hand!


config:push with .env does not support multline

If you have an environment variable with multiple lines config:push fails for that specific environment variable.

@sstarcher can you show an example of a multiline env variable?  from the dotenv docs, you can double-quote multiline strings and use literal \n to separate lines:
FOO="bar\nbaz"
Or are you saying that this is what doesn't work?

@benwilber currently with 1.10.0 multiple problems seems to exist.
With 1.10.0 I could use double quotes and add say an rsa key, but when that is put into a .env via pull only the first line gets set to the variable.
In addition if I would change it to not be a double quoted multi line and I would change it to be \n's the \ns would remain if I attempted to do something along the lines of
echo "$id_rsa" > /root/.ssh/id_rsa
the id_rsa would be invalid and contain \n

I just tested adding a double quote to the .env file that was spit out by deis config:pull, it acts the same was as if no quotes exist and for each line of the multiline string it outputs the line and "does not match the pattern 'key=var', ex: MODE=test"
When the same multiline with double quote is done on the command line it works correctly.

@sstarcher are you able to provide a couple quick examples of what you're seeing from deis config:pull and the same thing failing for deis config:push?

When I refer to Deis I'm referring to the platform version installed.  All of the below is using deis client 1.10.0
In Deis 1.10.0 On the command line the following has the expected result of setting a multiline variable.  Although it does complain does not match the pattern 'key=var', ex: MODE=test Creating config... ...
dquote> world how
dquote> are you" -a app
'DERPY=HELLO
world how
are you' does not match the pattern 'key=var', ex: MODE=test
Creating config... done

=== app Config
HEALTHCHECK_INITIAL_DELAY      60
HEALTHCHECK_TIMEOUT            300
HEALTHCHECK_URL                /

After doing the above everything finishes correct, but when I do a deis config:pull or a deis config:list I don't see DERPY listed at all.  This previously functioned with Deis 1.9.0.
On my Deis 1.9.0 system I have working multi line variables that show up when doing a deis config:list, but when I try to add new one's using the deis client 1.10.0 it no longer works and the added variables don't show up  in deis config:list
A deis config:pull on the old platform produces
HEALTHCHECK_TIMEOUT=300
id_rsa=-----BEGIN RSA PRIVATE KEY-----
STUFF
THINGS
-----END RSA PRIVATE KEY-----
HEALTHCHECK_URL=/
HEALTHCHECK_INITIAL_DELAY=60```

Which is not double quoted.

If I downgrade the deis client to 1.9.0 deis config:set with a multiline variable works and deis config:list shows the multiline variable.
If a multiline variable is set using deis client 1.9.0 and I do deis config:pull and deis config:push I get errors.  If I go into the .env file that was created and quote the multline string it still does not function.

This is a bug with the new go client. I didn't consider multi line variables when writing and they're not properly handled. You can see the file here. Allowing multi line variables with config:set should be as simple as fixing the regex. Multi line config variables with config:pull will be more difficult as the client currently parses the config file by iterating over newlines.

I fixed the
deis config:set TEST="multi
line
var"

issue in #4513.
I'm not sure what the best approach for solving multi line config:push  is, as newlines are used a separators for variables. How can you tell when a newline is part of a multi line config variable and not a config variable separator?

Could you take the naive approach and assume if you pass it through your regex and it does not match var=value than it goes with the previous variable?

this is still relevant for v2. I assume we should move to a more formal library such as https://github.com/joho/godotenv for parsing .env files.

This issue was moved to deis/workflow-cli#291


restructure markdown trail-1

Fixes https://github.com/python-sprints/pandas-mentoring/issues/90

@asvithajanani @WuraolaOyewusi PTAL.

This looks tidier and well put together. @sara-02
I like how added clear instructions. Thank you
Do you think we should still add the names? More people will be joining, do we want a lot of names?

@WuraolaOyewusi at this point how else to differentiate the points between learners, we can either go the way of names or via topics learned.

ok @sara-02 .I understand, We will keep the names


Changes command line to make swift compiler compile and run

What's the current behavior? Did the compiler hang or something?

It just compiles and neither runs nor produces executable. It was discussed recently in #64

That looks like an optimizer bug that we also ran into this week. Have you tried turning off -O?

Yes, I have tried with and without -O and behavior is the same - compiler just compiles and doesn't attempt to run compiled code. I don't think it's a bug. I think it's expected behavior. Input swift source code files might have some code on root level. In which order compile has to run this code? Undefined. That why compiler doesn’t try to do what isn’t defined. Merging several files into one we just remove undefined behavior.

@valeriyvan are you on linux?
on a mac, the above code works, but on linux, i see what you're seeing, eg:
(base) skoonce@squid:~/swift/swift-models/CIFAR$ swift -O models.swift data.swift main.swift
(base) skoonce@squid:~/swift/swift-models/CIFAR$

I am on mac. It only compiles. Doesn't run.
swift -version
Swift version 5.0-dev (LLVM dcb9eb74a7, Clang 95cdf7c9af, Swift 434442b530)
Target: x86_64-apple-darwin18.2.0

i am seeing the same:
dhcp209:CIFAR koonce$ swift -O models.swift data.swift main.swift
dhcp209:CIFAR koonce$
swift --version
Swift version 5.0-dev (LLVM dcb9eb74a7, Clang 95cdf7c9af, Swift 434442b530)
Target: x86_64-apple-darwin18.5.0

@brettkoonce, so for you it doesn't run as well, just compiles. Did you try cat models.swift data.swift main.swift | swift -O -?

If you run it with swiftc, it actually shows a compiler error here:
➜  CIFAR git:(stable) swiftc -O models.swift data.swift main.swift
data.swift:51:36: error: extra argument 'filename' in call
    return loadCIFARFile(filename: "test_batch")
                                   ^~~~~~~~~~~~

So I believe it's swift is errored and not doing the right thing (printing the error).

Ah, actually my branch was old. swift -O models.swift data.swift main.swift does terminate for me.


checksums for medium and large.tar?

Hi,
for the larger downloads I get connection aborts from your server with wget very frequently, almost every 2 hours. Looks like this:
2020-01-16 22:34:56 (10.9 MB/s) - Connection closed at byte<PHONE_NUMBER>29. Retrying.
Wget is retrying, but I fear it happened so often now that something is corrupted. Could you please release checksums (md5/sha or something like it)? Thank you and also many thanks for releasing this exciting dataset!

c49207eb86a8e8ac895561c37232041e  small.tar
c75e7ac62471bfbf2db77528d62a9b74  medium.tar
I'll let you know when large finishes summing, it will take a while.

@lunixbochs sums agree with mine - thanks for running those. I'm going to add them to readme as well for posterity.


Adding a Dice game

It is a game between two players. The one with higher dice number wins.
I can add this project to the repo

@kashnx There are enough projects at the moment


XGBoost4j-spark Build fail because NPE

Hello, recently I tried to build the xgboost-jvm locally, but was stucked "mvn package" in /jvm-package
Environment:
python 2.7
python3 3.11
java 1.8
spark 3.4.3
Code:
Master branch commit 9b465052cef6676090ff1dc2f9f8642a71d3bbc9
Reproduce:
1, Build Shared Library
2, cd jvm-packages, mvn package
Exception:
java.lang.NullPointerException
at ml.dmlc.xgboost4j.java.RabitTracker.loadEnvs(RabitTracker.java:124)
at ml.dmlc.xgboost4j.java.RabitTracker.startTrackerProcess(RabitTracker.java:176)
at ml.dmlc.xgboost4j.java.RabitTracker.start(RabitTracker.java:197)
at ml.dmlc.xgboost4j.scala.spark.XGBoost$.startTracker(XGBoost.scala:493)
at ml.dmlc.xgboost4j.scala.spark.XGBoost$.trainDistributed(XGBoost.scala:526)
at ml.dmlc.xgboost4j.scala.spark.XGBoostClassifier.train(XGBoostClassifier.scala:210)
at ml.dmlc.xgboost4j.scala.spark.XGBoostClassifier.train(XGBoostClassifier.scala:34)
I have tried to print the log and found that "trackerProcess" is alive but "reader.readLine()" is null in "LoadEnvs" function. BTW I can successfully build if mvn -Dskiptests. Is there any step/dependency I skipped? Appreciate any advice!

Hi, could you please make sure python3 is the default Python?

Hi, I've tried to alias python=python3 and ensured that pythonExec is "python3" in "RabitTracker.java" but the exception still happened. I wonder does the code exec python in sudo mode?
BTW I think python refers to python3 might be a little confusing. Shouldn't we replace "python" with "python3" in our .pom files and pythonExec default value?

@CrazyBinXXX, Can you hack startTrackerProcess to print the cmd in RabitTracker.java, and then run it in another terminal to see if it can work as expected?
  private boolean startTrackerProcess() {
    try {
      String cmd = getRabitTrackerCommand();
      trackerProcess.set(Runtime.getRuntime().exec(cmd));
      loadEnvs(trackerProcess.get().getInputStream());
      return true;
    } catch (IOException ioe) {
      ioe.printStackTrace();
      return false;
    }
  }

Actually I've hacked it.
!!!!!!!!!!!!!!!!!BIN LOG!!!!!!!!!!!!!!!!!
python3  /var/folders/ql/ld6nvq6d02z974sl6y8p2t7m0000gn/T/tracker1198335420923130425.py  --log-level=DEBUG  --num-workers=2
Process info: java.lang.UNIXProcess@2b62dddf
Process info: true
Process info: java.lang.UNIXProcess$ProcessPipeInputStream@6ecf25e
null
It seems to execute something in a temporary folder. I tried to execute it in another terminal and it gives me  "can't open file '/var/folders/ql/ld6nvq6d02z974sl6y8p2t7m0000gn/T/tracker1198335420923130425.py': [Errno 2] No such file or directory"

Try python3 xgboost4j/src/main/resources/tracker.py --log-level=DEBUG --num-workers=2

BTW, the recent PR https://github.com/dmlc/xgboost/pull/10112 will revise the whole Rabit part, where there will be no tracker.py anymore.

I finally solved it by a weird way --- running "cat /etc/hosts"

That's interesting.


Using pointerlock in mouse-keyboard-vr-display.js

currently on desktop, moving the camera imply to click+drag, and got limited by the window size
using pointerlock seems more natural
related to bug #115

pull request content:

when you click on the canvas, it will pointerLock the canvas.
the controls was already supporting pointerlock, so the hard work was done for me

i dont like this line in particular. It isn't a good way to access the canvas.
var canvasElement = document.querySelector('canvas')

Any suggestion on how to reach the canvas from vrDisplay ?

Agree, that's not a good way of doing it at all. See
CardboardVRDisplay: var gl = this.layer_.source; var canvas = gl.canvas;
On Fri, Jun 3, 2016 at 10:22 AM Jerome Etienne<EMAIL_ADDRESS>wrote:

i dont like this line
https://github.com/borismus/webvr-polyfill/pull/123/files#diff-2b7460a05ed70a3ca7b37bbc5d23ff6fR131
in particular. It isn't a good way to access the canvas.
var canvasElement = document.querySelector('canvas')
Any suggestion on how to reach the canvas from vrDisplay ?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/borismus/webvr-polyfill/pull/123#issuecomment-223640042,
or mute the thread
https://github.com/notifications/unsubscribe/AAQ8gIbIdJcIlENwqnygsVrNlzm-nK6Pks5qIGLqgaJpZM4Itu-3
.

@borismus during the basic examples on desktop, vrDisplay.layer_ is null
from what i understand of base.js, vrDisplay.layer_ is set only when presenting, and mouse-keyboard-vr-display.js can't present. see here
maybe i could use document.body like the other events?

i made the change to use document.body instead, what do you think ?

i did all the styling changes i could find. sorry about that, i still have to get used to the google style.

ping: any news about this one ?
as far as i know, all requested changes have been done, and all questions answered.
(just trying to make it happen)

oh interesting! btw i will be in sunnyvale monday-thursday, i would love to have lunch and sync about ar/vr.

Jerome, happy to meet you tomorrow. I'm free for lunch too. Let me know if
you can come to 1365 Shorebird around noon.
On Sat, Jun 25, 2016 at 3:19 AM Jerome Etienne<EMAIL_ADDRESS>wrote:

oh interesting! btw i will be in sunnyvale monday-thursday, i would love
to have lunch and sync about ar/vr.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/borismus/webvr-polyfill/pull/123#issuecomment-228529459,
or mute the thread
https://github.com/notifications/unsubscribe/AAQ8gOO4mnu10pWS7V8AzmPYQJsDL_lrks5qPQCagaJpZM4Itu-3
.

excelent i will be there, i looked and this is a big google building, any
specific location in this building ? like the entrance maybe ?
On Tue, Jun 28, 2016 at 12:33 PM Boris Smus<EMAIL_ADDRESS>wrote:

Jerome, happy to meet you tomorrow. I'm free for lunch too. Let me know if
you can come to 1365 Shorebird around noon.
On Sat, Jun 25, 2016 at 3:19 AM Jerome Etienne<EMAIL_ADDRESS>wrote:

oh interesting! btw i will be in sunnyvale monday-thursday, i would love
to have lunch and sync about ar/vr.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
<
https://github.com/borismus/webvr-polyfill/pull/123#issuecomment-228529459
,
or mute the thread
<
https://github.com/notifications/unsubscribe/AAQ8gOO4mnu10pWS7V8AzmPYQJsDL_lrks5qPQCagaJpZM4Itu-3
.

—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/borismus/webvr-polyfill/pull/123#issuecomment-229157357,
or mute the thread
https://github.com/notifications/unsubscribe/AAPcIr7B0qWyq3JDEPzxP1WFnq4D0Sk3ks5qQXb5gaJpZM4Itu-3
.

Sorry for delay. Jerome, I'm thinking about it more, and I'm not sure that we want to pointerlock by default. In some cases we want to leave the mouse for interactions on desktop.

@borismus i understand the tradeoff.

on one hand, provide a better navigation for the dragging in webgl
on the other hand, to allow interaction with other web elements

What about http://www.ottoandnewt.com/ this UI. It enter in pointerlock only when clicked.
It joins the 2 requirements. when mouse button is pressed, it act as pointerlock, when not pressed, it allows interactions with other elements.


Provide additional type information in WHERE clause

[x] Feature
[ ] Bug Request

Description
When parsing WHERE clauses, we should store indicators of the field type if possible.  It would be useful to know if a date literal is used or if the type is a string or some other type so that consumers can more reliably build a compose object to be parsed.
Example:
This query has multiple data types where some need to be quoted and others do not.
SELECT Id FROM Account WHERE dateField != '2018-10-03' AND dateField < LAST_WEEK AND isDeleted = false AND someOTherField = 'someVal'
TODO

[x] Add type information for fields
[x] Add type information for date literals and date n literals
[ ] having clause updated with literal types
[x] update unit tests

[ ] confirm that any new tests are added for full coverage

[ ] update changelog
[ ] array values in the WHERE clause don't fit the data model for LiteralType - may need to implement breaking change or find some other way to represent the types for these fields
example:

{
    testCase: 34,
    soql: `SELECT Id FROM Account WHERE Foo IN ('1', '2', '3') OR Bar IN (1, 2, 3) OR Baz IN (101.00, 102.50) OR Bam IN ('FOO', null)`,
    output: {
      fields: [
        {
          text: 'Id',
        },
      ],
      subqueries: [],
      sObject: 'Account',
      where: {
        left: {
          field: 'Foo',
          operator: 'IN',
          value: ["'1'", "'2'", "'3'"],
          literalType: 'STRING',
        },
        operator: 'OR',
        right: {
          left: {
            field: 'Bar',
            operator: 'IN',
            value: ['1', '2', '3'],
            literalType: 'INTEGER',
          },
          operator: 'OR',
          right: {
            left: {
              field: 'Baz',
              operator: 'IN',
              value: ['101.00', '102.50'],
              literalType: 'DECIMAL',
            },
            operator: 'OR',
            right: {
              left: {
                field: 'Bam',
                operator: 'IN',
                value: ["'FOO'", 'null'],
                literalType: 'NULL',
              },
            },
          },
        },
      },
    },
  },

@paustint Here's how I dealt with it in ts-force-qry (I built an conditional abstraction layer over yours, partially to deal with this issue; partially to make the WHERE & HAVING clauses more human readable)
My "Condition" looks like this:
type Value = string | number | boolean | Date | string[];

type BaseCondition = { field: string, op: Operator, not?: boolean, formatter?: (d: Value) => string | string[] }

type PrimitiveConditionParams = { val: Value } & BaseCondition;
type SubQueryConditionParams = { subqry: string } & BaseCondition;

type ConditionParams = PrimitiveConditionParams | SubQueryConditionParams

If formatter function is not supplied then I render a default format based on the value type:

boolean | numbers just output toString()
strings | string[] each string gets wrapped in single quote
Date: format to YYYY-MM-DDThh:mm:ssZ

I might provide some out of the box formatters for common cases like formatting a Date to YYYY-MM-DD or different timezones.
Here's my code where you can see all this together  (it's a mess; don't judge 🤦♂ )
Subqueries
While subqueries (EG: WHERE Id IN (SELECT AccountId FROM Contact)) could have been handled with a simple format like so:
{field: 'Id', op: 'IN', val: 'SELECT AccountId FROM Contact', formatter: s => `(${s})`}

I split them out to it's own type which takes a param subqry instead of val so you don't have to think about it.  However, I think for the purposes of this library, it might make more sense for Value to just accept a SubQuery, where subquery is basically Query but with types updated to reflect what is allowed in a WHERE subquery.
type Value = string | number | boolean | Date | string[] | SubQuery;


Security

What’s your take on the security of passing the message off from iMessage (end to end encryption) to Andromeda (no encryption?)? Thanks and great project.

This project is 100% security through obscurity. I hope soon to upgrade to SSL sockets and server but it’s a time a issue and will require a rewrite. The project is small enough that unless someone specifically wants to attack YOU it’s safe.
Also is this a question or a complaint? Haha.

Oh it was a total question. I’m not familiar with how the iMessage would be handed off. Thanks!

Yeah, it's on the roadmap. I fully aware that unencrypted iMessage isn't great but this was really a hack.

Huh. I wonder if you could use another messaging app with encryption (like Signal) to hand off the iMessage to it? (I am obviously not a programmer so thank you for humoring me).

Hi:
Have you tested the server with MacOS High Sierra? Does it still function like Sierra?
Please let me know.
Thanks!
On Oct 5, 2017, at 7:34 AM, Salman Husain<EMAIL_ADDRESS>wrote:
Yeah, it's on the roadmap. I fully aware that unencrypted iMessage isn't great but this was really a hack.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub https://github.com/shusain93/Andromeda-iMessage/issues/13#issuecomment-334484085, or mute the thread https://github.com/notifications/unsubscribe-auth/AG0HasPVqjT7UlgA4UviObEsm25OdsgSks5spOj_gaJpZM4PvBl1.

Please create a new issue next time. Do not pick a random issue. No, I have not checked. If it's broken let me know.


add option for listing files recursively

By default, only first-level files are listed from directories (the same as before). With the new option --recursive, all subdirectories are also scanned recursively.

LGTM


Support selector.after in show rules

Description
Allow constraining show rules with the functions listed in https://typst.app/docs/reference/types/selector/#methods.
E.g. using .after() on a selector.
Use Case
I want to add extra spacing between italic and footnotes, so I'd expect writing a show rule like:
show selector(footnote).after(emph): it => {h(2pt); it}

The after selector wouldn't do what you want even if supported by show rules. As stated it would select all footnote that have any emphasized text before them (somewhere in the document, not directly).

As stated it would select all footnote that have any emphasized text before them (somewhere in the document, not directly).

Oh, so I'd need something like "directly_after"?

Yes

Here is what I need (based on GOST standard; from #4281):
#show heading.next(heading): set heading(below: 0pt) // If they will accumulate.
#show heading.previous(heading): set heading(above: 2em) // Considering `1em` is distance between baselines, which it isn't for now.

#show heading.previous(not heading): set heading(above: 3em) // `not heading` means "text".
#show heading.next(not heading): set heading(below: 3em)


[Feature Request] Let the user choose which architecture to build

The target architecture(s) (amd64 or arm64) should be configurable.
Expected Behaviour

I would like to be able to choose which architecture I want to build without patching rules.mk.
Current Behaviour

The targets actually build both amd64 and arm64.
Possible Solution

The dirty way, patching rules.mk:
diff --git a/rules.mk b/rules.mk
index b2c5133..717e1da 100644
--- a/rules.mk
+++ b/rules.mk
@@ -22,7 +22,7 @@ ifeq ($(ARCH),aarch64)
 ARCH = arm64
 endif

-arches := amd64 arm64
+arches := amd64
 modes := rel dbg

 hook-bootkit-deps := $(wildcard hook-bootkit/*)
@@ -87,7 +87,7 @@ push-hook-bootkit push-hook-docker:
        docker buildx build --platform $$platforms --push -t $(ORG)/$(container):$T $(container)

 .PHONY: dist
-dist: out/$T/rel/amd64/hook.tar out/$T/rel/arm64/hook.tar ## Build tarballs for distribution
+dist: out/$T/rel/amd64/hook.tar ## Build tarballs for distribution
 dbg-dist: out/$T/dbg/$(ARCH)/hook.tar ## Build debug enabled tarball
 dist dbg-dist:
        for f in $^; do
ubuntu@factory:~/tinkerbell/hook$ git diff > ../hook.patch
ubuntu@factory:~/tinkerbell/hook$ cat ../hook.patch
diff --git a/rules.mk b/rules.mk
index b2c5133..717e1da 100644
--- a/rules.mk
+++ b/rules.mk
@@ -22,7 +22,7 @@ ifeq ($(ARCH),aarch64)
 ARCH = arm64
 endif

-arches := amd64 arm64
+arches := amd64
 modes := rel dbg

 hook-bootkit-deps := $(wildcard hook-bootkit/*)
@@ -87,7 +87,7 @@ push-hook-bootkit push-hook-docker:
        docker buildx build --platform $$platforms --push -t $(ORG)/$(container):$T $(container)

 .PHONY: dist
-dist: out/$T/rel/amd64/hook.tar out/$T/rel/arm64/hook.tar ## Build tarballs for distribution
+dist: out/$T/rel/amd64/hook.tar ## Build tarballs for distribution
 dbg-dist: out/$T/dbg/$(ARCH)/hook.tar ## Build debug enabled tarball
 dist dbg-dist:
        for f in $^; do

Context

Three reasons:

I only need one architecture, the one I am using
I want to reduce my building time skipping arm64
I want to avoid possible building failures outside of my scope

Hey @mgrzybek . Thanks for reporting this. Apologies for the very delayed response. The build process has been completely refactored and this capability is now available. ./build.sh build hook-latest-lts-amd64 for x86_64 and ./build.sh build hook-latest-lts-arm64 for arm64. Try it out and let me know how it goes. Thanks!


Is this project still alive?

cloudasr.com seems to be dead. Thanks

Hi,
I am sorry, the service www.cloudasr.com is down as we don't have any servers to host it. The code and models should work and we might release new models next year. Are you interested in the service or do you want to run it on your servers?
Ondrej

@choko
@schadom
We may be able to host it with a demo on our company website.
Can you tell me what is your use-case for it?

Hi @oplatek,
currently no concrete use-case besides playing around with different ASR technologies.

@bamba518 In the thesis we used 1000 fake ASR engines, because we didn't have big enough cluster to run 1000 real ASR engines. In theory, the only limit for the number of parallel requests is a size of your cluster, because one worker can handle only one request.

@choko does the size of cluster mean that each core can only handle 1 worker? so 1000 parallel request requires 1000 cores?

I was just going to us this model
http://goofy.zamia.org/zamia-speech/asr-models/kaldi-generic-en-tdnn_f-r20180901.tar.xz
My goal is to handle thousands of parallel connections using http streaming, do you have any recommendations ?

I am not familiar with this model, but TDNN-F models should be a good choice. Make sure to rebuild the docker images, because nnet3 models are not supported in the docker images available from the docker hub.


Standardize display info in confirmation modals #671

Looks Like Codacy did not like this. I will investigate.
This pull request is kind of large, I think that this should be the upper limit of how big a pull request should be. Anything larger I feel might cause conflicts as it might be hard to track of how stale branches are.
In general.controller.js, why was a 3rd equals sign added in boolean expressions in multiple locations? My current knowledge is that the "equals" operation should be "==" or only be two equals signs. Please let me know why my understanding does not line up with yours.
Other than those small comments, this branch looks good. Now to look at Codacy to find out what's going on!

I just looked on Codacy, if you do not want to go through Codacy the issue seems to be a very minor syntax error.
On mainv2_3.css line 441, the indentation seems to slightly off, I took a look at the commit and in GitHub I cannot see the indentation so I am not sure what's going on. Can you please take a look into satisfying Codacy? If not, No worries! Codacy might be broken again.
Link to Codacy: https://app.codacy.com/gh/uhawaii-system-its-ti-iam/uh-groupings-ui/pullRequest?prid=8443036

Looks Like Codacy did not like this. I will investigate.
This pull request is kind of large, I think that this should be the upper limit of how big a pull request should be. Anything larger I feel might cause conflicts as it might be hard to track of how stale branches are.
In general.controller.js, why was a 3rd equals sign added in boolean expressions in multiple locations? My current knowledge is that the "equals" operation should be "==" or only be two equals signs. Please let me know why my understanding does not line up with yours.
Other than those small comments, this branch looks good. Now to look at Codacy to find out what's going on!

I believe in JS the "==" changes the two thing's you are comparing to the same type so I should go back and change some of the @param label back to a string instead of an object. It makes more sense to me to use the "===" so that we don't get that type conversion which could cause unexpected results.

Codacy is reporting the indentation issue because we previously agreed that we indent 4 spaces and I updated Codacy accordingly.  The file us using a 2 character indent.  I recommend we consistently use 4 character indentations.

I fixed the codacy issues and changed the @param {object} to @param {string}. To get rid of what happened with other peoples commits in mines I squashed their changes with mines.

Hey, what does this mean?: "squashed their changes with mine". That sounds extraordinary unusual.

Hey, what does this mean?: "squashed their changes with mine". That sounds extraordinarily unusual.

Sorry about that, before it was showing a bunch of other peoples commits with mines in the pull request so to make the pull request look cleaner I squashed those commits into the "standardized display user info in modals".

Also looks fine to me, I will commit the PR.


Remove call to external commands

Replace the call to find, by Find.find function.
Replace diff equivalent on Windows.

Note: there isn't -u/--label option on Windows, we just do the diff without this extra arguments.

I close this PR, please see #1182.


Remove KubernetesTarget related controllers

Description of your changes

https://github.com/crossplane/crossplane/issues/1755
See the above issue for context.
I have:

[x] Read and followed Crossplane's contribution process.
[x] Run make reviewable test to ensure this PR is ready for review.

How has this code been tested
It has not, except that it compiles

Can we wait the patch release before merging this?


Add a custom user-agent to python api client

To help identify requests sent by the python api client is access logs, we should add a customer user-agent.

We currently can't differentiate API vs otherboto3 usage in our s3 logs, so it would be useful to enable this for improved analytics.


Error, after connect, if auth enabled

Hello. I have issue with connecting to mongod with enabled authentication
I start mongod like this mongod --auth --syslog --fork
Then i try connect to my database with adminMongo.
mongodb://admin:pass@hostname:27017/dbname
User admin and database dbname already exist in my mongo.
And i get error:
TypeError: Cannot read property 'size' of undefined
    at /home/adminMongo/routes/index.js:1130:58
    at handleCallback (/home/adminMongo/node_modules/mongodb/lib/utils.js:96:12)
    at /home/adminMongo/node_modules/mongodb/lib/db.js:299:20
    at /home/adminMongo/node_modules/mongodb/node_modules/mongodb-core/lib/topologies/server.js:778:46
    at Callbacks.emit (/home/adminMongo/node_modules/mongodb/node_modules/mongodb-core/lib/topologies/server.js:95:3)
    at null.messageHandler (/home/adminMongo/node_modules/mongodb/node_modules/mongodb-core/lib/topologies/server.js:249:23)
    at Socket.<anonymous> (/home/adminMongo/node_modules/mongodb/node_modules/mongodb-core/lib/connection/connection.js:265:22)
    at emitOne (events.js:77:13)
    at Socket.emit (events.js:169:7)
    at readableAddChunk (_stream_readable.js:146:16)

If i not pass --auth param to mongod, with authentication it's all ok.

Can you try omitting the dbname from your connection string?

@mrvautin it work. thank you!

Need to build in some better error handling around the gathering of stats. If cannot get stars for collection, need to return a null or "n/a" value.


Place design Error (Implementation failed)

Synthesises successfully but throws "place design error" during implementation when we source the base.tcl file.
Could you please let me know what might be missing?
Error screenshots attached below:

The first thing that I have noticed, is that you are using Vivado 2016.2. The base.tcl on image v2.0 is verified and tested based on Vivado 2016.1, while there is no guarantee that the same tcl file will work for 2016.2. Is there a reason why you must use Vivado 2016.2?
Also, we are working on a new release which supports Vivado 2017.2.
Hope this helps.

Thank you! There is no specific reason to use 2016.2. I had that installed on my system and have been working on either 2016.2 or 2016.4 of late, so tried with that version.
That's great!
Also, ideally before reaching this implementation step, based on the condition in base.tcl file it should fail in the beginning itself (which it did).
I changed the base.tcl script by making it run with 2016.2. It worked fine starting from sourcing the tcl files and building the PYNQ repository until Synthesis.
The only reason I couldn't get is if it is version specific, it should fail initially even if I changed the tcl (one if condition block).
Could you please comment or give input on this?

https://github.com/Xilinx/PYNQ/blob/master/boards/Pynq-Z1/base/base.tcl#L76
We do have that checking. But if you tried to change the version number, that is almost like a hack, so it may fail...

Ok, yeah! Thank you! It worked on 2016.1 version only.


Replace knative.dev/client references with knative.dev/client-pkg

Changes

🧹 Replaced knative.dev/client references to knative.dev/client-pkg

/kind cleanup

Part of https://github.com/knative/client/issues/1591

Release Note

Docs

/approve
/lgtm


testing 4.18 tag under macOS - no visible feed

Hi there...
I am testing the 4.18 version with macOS 10.13.2 [High Sierra], the project builds fine, and the plugin sees the NDI sender fine, it just doesn't render any image within the mediaPlayer, [black screen, play button greyed out on the transport bar].
It seems to be not detecting a feed, but the log gives no feedback...
Has anyone encountered this and/or has a fix? Many thanks in advance
Nick

Unreal 4.18 on windows 10. we're having the same issue. Sender Name is found correctly, but black screen.

Please try the latest version for 4.19, thanks!

Make sure to check the updated README. The NDI SDK is no longer included in the 4.19 plug-in. You need to download and install the NDI SDK.


terminal - was supposed to call equivelent commands where poss on cmd. and vice versa

i.e. ls to call dir and vice versa.
this was the original plan and still not done.

lots of commands need testing also

https://plumbum.readthedocs.io/en/latest/
looks like this idea already existed for a long time.


RuntimeError: tensors are on different GPUs

File "main.py", line 306, in
main()
File "main.py", line 126, in main
train(train_loader, model, criterion, optimizer, epoch)
File "main.py", line 171, in train
output = model(input_var)
File "/home/work/.jumbo/lib/python2.7/site-packages/torch/nn/modules/module.py", line 206, in call
result = self.forward(*input, **kwargs)
File "/home/work/.jumbo/lib/python2.7/site-packages/torch/nn/parallel/data_parallel.py", line 59, in forward
return self.module(*inputs[0], **kwargs[0])
File "/home/work/.jumbo/lib/python2.7/site-packages/torch/nn/modules/module.py", line 206, in call
result = self.forward(*input, **kwargs)
File "/home/work/kr/libs/TSN/tsn-pytorch/models.py", line 197, in forward
base_out = self.base_model(input.view((-1, sample_len) + input.size()[-2:]))
File "/home/work/.jumbo/lib/python2.7/site-packages/torch/nn/modules/module.py", line 206, in call
result = self.forward(*input, **kwargs)
File "/home/work/kr/libs/TSN/tsn-pytorch/tf_model_zoo/bninception/pytorch_load.py", line 57, in forward
data_dict[op[2]] = getattr(self, op[0])(data_dict[op[-1]])
File "/home/work/.jumbo/lib/python2.7/site-packages/torch/nn/modules/module.py", line 206, in call
result = self.forward(*input, **kwargs)
File "/home/work/.jumbo/lib/python2.7/site-packages/torch/nn/modules/conv.py", line 237, in forward
self.padding, self.dilation, self.groups)
File "/home/work/.jumbo/lib/python2.7/site-packages/torch/nn/functional.py", line 40, in conv2d
return f(input, weight, bias)
RuntimeError: tensors are on different GPUs

Can you provide more context so others can better help you?

I met the same problem when I tried to train TSN on only one GPU, ,maybe the network parameters and input data are loaded into different GPUs? But I have set the argument --gpus to 1 specific GPU. Can you help me with the problem, thank you very much!

I met the same problem when I tried to train TSN on only one GPU,Can you solve it now?thank  you very much!

I met the same problem when I tried to train TSN on only one GPU,Can you solve it now?thank you very much!

Well, I tried lots of methods. To set parameter device_ids explicitly in every cuda function works for me, you can try it.


Is it possible to add jamming beams as a secondary weapon?

I recognize that jamming beams are really complicated to automate and dealing with them is very unmapped territory.

Possibly but as you note it gets strange quickly in terms of if you land a jam, what is the optimal token to remove, etc. I might add it at some point with some predictable heuristic, but over multiple attacks it's not necessarily easy to decide what the best jam target is.


Update examples of ::className() in TimestampBehavior

Update examples in TimestampBehavior to ::class instead of ::className()

Q
A

Is bugfix?
❌

New feature?
❌

Breaks BC?
❌

Tests pass?
✔

Fixed issues
N/A

We support 5.4. Can't merge it.


Get AC / AC_REPLICA tests working

These tests involve testing AC performance of the ADC using ENOB as a metric.  Issues StanfordVLSI/dragonphy#58 and StanfordVLSI/issue_staging#18 are a prerequisites.

This is resolved in PR #11


Training on A100

Thank you for your great work. I finetune the 12b model on an 8-card A100 40G using fp16 and deepspeed stage=3, per-device-train-batch-size=2, and gradient_accumulation_steps=4. The processed dataset had 10,971,000 rows after filtering for truncated records. During training, I found that the speed was approximately 10.8 hours per 1% epoch data, so it would take about 45 days to complete one epoch. Is it normal for it to be this slow?

That's a lot of data for fine-tuning, maybe too much. After all, I think dolly saw about 10 epochs x 15k example for all of its fine tuning, which is a few percent of what you're trying to run.
Don't use fp16, let it use bf16. Why turn on gradient accumulation steps and reduce batch size - are you running OOM? that slows things down otherwise.
Your runtime seems kind of plausible, though I bet it could be faster. However, you're going to spend tens of thousands of dollars to see the whole dataset, so consider whether that's necessary vs just stopping at some checkpoint after it seems to converge.

Thank you for your response. I am trying to fine-tune Dolly's knowledge on Chinese data, so I have collected a considerable amount of data. However, I am experiencing CUDA OUT OF MEMORY errors when using bf16 on the A100 40G, and even batch size 4 is causing OOM issues. Therefore, I am using fp16 and gradient accumulation. The following is the GPU memory usage during training：
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 470.82.01    Driver Version: 470.82.01    CUDA Version: 11.4     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  NVIDIA A100-SXM...  On   | 00000000:0E:00.0 Off |                    0 |
| N/A   56C    P0   279W / 400W |  40104MiB / 40536MiB |    100%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   1  NVIDIA A100-SXM...  On   | 00000000:13:00.0 Off |                    0 |
| N/A   47C    P0   190W / 400W |  40522MiB / 40536MiB |    100%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   2  NVIDIA A100-SXM...  On   | 00000000:4B:00.0 Off |                    0 |
| N/A   41C    P0   142W / 400W |  40392MiB / 40536MiB |    100%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   3  NVIDIA A100-SXM...  On   | 00000000:51:00.0 Off |                    0 |
| N/A   54C    P0   173W / 400W |  40468MiB / 40536MiB |    100%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   4  NVIDIA A100-SXM...  On   | 00000000:93:00.0 Off |                    0 |
| N/A   57C    P0   277W / 400W |  40326MiB / 40536MiB |    100%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   5  NVIDIA A100-SXM...  On   | 00000000:99:00.0 Off |                    0 |
| N/A   42C    P0   247W / 400W |  40494MiB / 40536MiB |    100%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   6  NVIDIA A100-SXM...  On   | 00000000:CB:00.0 Off |                    0 |
| N/A   53C    P0   324W / 400W |  39780MiB / 40536MiB |    100%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+
|   7  NVIDIA A100-SXM...  On   | 00000000:D0:00.0 Off |                    0 |
| N/A   51C    P0   206W / 400W |  39126MiB / 40536MiB |    100%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+

bf16 should still be used instead of fp16; it doesn't increase mem usage. OK, it's possible you do need more memory if your input tokenizes differently and you have long sequences. You are retraining the tokenizer too? the given tokenizer is for English language text.

Here's the issue at hand: with the same configuration and parameters, bf16 encounters OOM errors while fp16 does not. Considering that expanding the vocabulary will add additional untrained weights, I have not expanded the vocabulary, the given tokenizer based on Unicode can encode almost all Chinese characters.

I may understand your needs. Because the tokenizer of the existing Dolly model is only for English, it is meaningless if you want to train Chinese corpus on it. Therefore, if you want to train on Chinese corpus, you need to reconstruct the tokenizer for training. The existing Dolly model It doesn't solve your existing needs.

Right, does not make sense to fine-tune Pythia, either; it was pre-trained on the Pile, which is mostly English text.

https://github.com/facebookresearch/llama/blob/main/FAQ.md#4
I think this applies to Dolly as well.

Yes, although, this model was derived from Pythia, not LLaMa.


Add dependent-map package

I'm not sure this is right place to ask, but how does this library compare with Data.SortedMap.Dependent from base?

Thanks.

@buzden In Data.SortedMap.Dependent, the types of values are dependent on keys, but the key is just a regular type. In this package, the types of keys and values are both dependent on a parameter and for any given key-value pair, the value of that parameter must be the same.
In other words:

SortedDMap : (k :      Type) -> (v : k -> Type) -> Type
DMap       : (k : a -> Type) -> (f : a -> Type) -> Type


Standard metrics

@dafnapension @elronbandel - Can you explain the motivation for this PR? What are standard metrics and how do they relate to the existing metrics?

@elronbandel @dafnapension - I'm sure you discussed it between you alot, but I want to provide a different perspective.
I think stream in unitxt may be useful if unitxt  used for large scale training - however, it also has significant cost in terms of code and API complexity.   In evaluation , where typically only hundres of samples are tested, streaming will have no significant value.
We need metrics API that are
(1) independent from each other
(2) easy for users to add  AND debug them.
Therefore, I think it's worth to have a discussion if this direction will have a net gain in terms of unitxt acceptance.
(@eladven - will be glad your input as well).

Leave for now, if at all, continue via https://github.com/IBM/unitxt/pull/845


Only accepts dockerfile named Dockerfile

Current Behavior
If I name my dockerfile something other than 'Dockerfile' (say 'db.Dockerfile'), during app deploy it will give me this error: "unable to prepare context: context must be a directory".
$ ecs-preview app init --dockerfile "db.Dockerfile"
$ ecs-preview app deploy # throws error

Expected Behavior
Not throwing this error

Plus, if dockerfile path is not passed in by a flag then "pb.Dockerfile" cannot be recognized and listed when selecting which dockerfile to use.


First draft Nebari landing page

This is my first draft at the Nebari landing page. I figured it would be better to get some code up now and then we can fix all of the outstanding issues in a subsequent PR.
Known issues:

Header is not the same as in the Figma file. Do we want to make the header for the landing page different than all of the other pages, and if so, how?
Ditto for the footer.
All of the background (and some foreground) decorations are missing. I will add them in a follow-up PR.
I'm not sure what the background color for the home page should be. Ditto for max width (I set it to 1440px, as in the Figma file).
The design is responsive, but there are still some tweaks needed.
There's something wrong with the SVGs for the integrations, which I exported from the Figma. Depending on which browser you use, you might see Grafana, Prefect, or VSCode logos all messed up. Not sure why. Those SVGs might need to be fixed in the Figma?
I assume there is no dark mode version of the home page since it alternates between light and dark sections. So I didn't make a dark mode version of the home page. However, the home page inherits the general site-wide styles, so when dark mode is turned on, it messes up some of the colors that I chose. So I need to fix that.

Oh, also pre-commit was putting out some errors locally that made no sense, so I committed with --no-verify.

Hmm, how do we preview the landing page on Netlify with this redirect?
Would it be better if I park it at /home until we're ready to move it to /?

Thank you, @gabalafou! This is looking really good!

I'm not sure what the background color for the home page should be. Ditto for max width (I set it to 1440px, as in the Figma file).

I think we can have each section's background color be full-screen-width? @trallard can confirm :)
Right now, it looks perfect on my macbook-screen, but I see the following on my monitor:

Hmm, how do we preview the landing page on Netlify with this redirect?'

I clicked on the Nebari logo in the top left corner, and it took me to the landing page :)

Oh nice, thanks for looking at this @pavithraes! I went ahead and made each section's background span the full page width.

For the record, here's how the integration SVG logos look in Safari:

Here's how they look in Chrome:

Interestingly, all of the logos look fine under the files changed tab of this PR, using Chrome. So maybe I'm doing something wrong in the way I use the SVGs in the app code?

Hey @gabalafou, this looks great already 🎉 🙏🏽  thanks for working on this... now onto the known issues

Header is not the same as in the Figma file. Do we want to make the header for the landing page different than all of the other pages, and if so, how?

Let's leave the header we have, as we need the search function

Ditto for the footer.
The footer will need to change to the one in the Figma file. This can be done in a later PR if needed.

I'm not sure what the background color for the home page should be.
Background colours should be:

will get back to this tomorrow

I assume there is no dark mode version of the home page since it alternates between light and dark sections. So I didn't make a dark mode version of the home page. However, the home page inherits the general site-wide styles, so when dark mode is turned on, it messes up some of the colors that I chose. So I need to fix that.

Yeah there is no dark mode - I am not sure if we can remove the toggle on the home page only
Re icons: I see the same as you, @gabalafou - will inspect the code + svgs tomorrow as it is too late for me now 😴

Oh, also pre-commit was putting out some errors locally that made no sense, so I committed with --no-verify.

Scratch that. I was using some older pre-commit hook or something.
For the record, when I first tried to run pre-commit install, I got the following error:
[ERROR] Cowardly refusing to install hooks with `core.hooksPath` set.
hint: `git config --unset-all core.hooksPath`

Not knowing what that was about, I skipped it. Then I got errors when I tried to commit. Then I went back and ran the suggested git config command. Then I made a change, committed it, and everything was fine.

Ah I have seen that pre-commit issue before. Root case suspicion: you might have run the pre-commit outside a project/directory with the pre-commit config file and applied global settings

@pavithraes or @kcpevey  I cannot remember who was getting the screenshots for the main page - do we have this? we definitely need to replace the stock image in the landing page

Ok - I just opened the preview again and now I see a different thing regarding the integrations

🤔  I am unsure where this is coming from - asked for the updated svg files but might be at the  website-logic level

Yeah there is no dark mode - I am not sure if we can remove the toggle on the home page only

I'm not sure, but maybe https://docusaurus.io/docs/next/api/themes/configuration#hooks can help?

@pavithraes or @kcpevey I cannot remember who was getting the screenshots for the main page - do we have this? we definitely need to replace the stock image in the landing page

I'm happy to get this. We need to create the demo video for PyData NYC, we can have a trimmed-version of that as a GIF for the landing page.

@pavithraes thanks for the tip! But I think what I need to do is add some override styles to the CSS, as the Styling and Layout - Dark Mode section of the docs suggests.

I went down a little rabbit hole. The reason the inline SVGs aren't working is because of the way Docusaurus has configured its SVG loader internally. Docusaurus uses the Webpack loader for SVGR. SVGR in turn uses SVGO. By default, SVGO minifies SVG ids. Some of these SVG logos uses internal identifiers. When those ids get minified to single characters (like "a", "b", "c"), they clash on the page. SVGO has an option to prefix ids, but Docusaurus has not turned that option on. I created a minimal reproduction of the bug. You can comment out one SVG at a time from the source code, and see that when only one SVG is on the page, it renders properly. But when both are on the page, one clashes with the other.
I'm not sure how to fix it. I tried adding a plugin to Docusaurus that overwrites the Webpack config, but my attempt didn't work.
I've opened an issue with Docusaurus:

https://github.com/facebook/docusaurus/issues/8297

For now, I'm just going to replace the conflicting inline SVGs with img tags.


perf: Improve dfa matching

Various improvements from profiling RegexSet::matches usage.
 name                old ns/iter    new ns/iter    diff ns/iter   diff %  speedup
 misc::is_match_set  73 (342 MB/s)  76 (328 MB/s)             3    4.11%   x 0.96
 misc::matches_set   857 (29 MB/s)  604 (41 MB/s)          -253  -29.52%   x 1.42

Interesting! Nice improvements. Can you brainstorm ways of removing the new use of unsafe introduced in this PR? I think I buy your safety argument, but I also think I want to have a higher bar for introducing the use of unsafe. Does this improve specific use cases or do you expect it to have improvements across the board? I would guess the former off the top of my head.

@Marwes Also, if you're going to continue digging into more performance optimizations outside this PR, I'd like to request that we limit their scope to smaller changes. I am planning a complete rearchitecture of this crate and don't want to push much harder on the existing infrastructure.

Can you brainstorm ways of removing the new use of unsafe introduced in this PR?

In 1.21 there are impl<'a, T> From<&'a [T]> for Rc<[T]>  which would make it possible to use a Rc pointer instead but that's the closest.
The safety considerations is the same for Pin/immovable values. It is fine to hold a reference to a heap allocated value as long as it does not get freed and in this case the heap values only gets freed after map keys.

Does this improve specific use cases or do you expect it to have improvements across the board?

I have no idea how much it improves for other cases but it should always be an improvement as it avoids an allocation and copy for every created state. It wasn't the most significant improvement however and if you expect that StateMap won't be needed after a re-factoring I might as well remove it.

Also, if you're going to continue digging into more performance optimizations outside this PR, I'd like to request that we limit their scope to smaller changes.

I am not planning on doing any further improvements. I have just been doing some experimentation from time to time and these were the changes that actually made a noticeable difference. So I just packed it all up today as something mergeable.

I am planning a complete rearchitecture of this crate and don't want to push much harder on the existing infrastructure.

I saw this while looking through some issues which is part of why I didn't want to let the branch get stale, hopefully at least some of the changes are agnostic enough to survive it.

ping @BurntSushi Is any of these changes still interesting? Should I remove the improvement involving unsafe?

@Marwes Thanks for pinging me on this. I think in order for me to be comfortable with the unsafe, I would need to do a more careful review of the code in addition to a performance analysis myself. Otherwise, it's too hard for me to judge whether it's worth it. So it might be worth getting rid of the unsafe.

While that particular unsafe usage is mostly safe and is relatively common unless one uses third-party wrapper like owning_ref, I think it might worth replacing it here with Rc (and correspondingly changing State::data).
The cost of increasing non-atomic counter will be pretty much negligible compared to everything else regex already does, and it would still save the memory in the same way unsafe &[u8] does in current code.

@RReverser I would just replace it with Rc in this case, except that would require regex to do a minimum version bump to 1.21 (from 1.20) so that may not be desirable. (Or it could be Rc<Box<[T]>> I suppose, a double indirection shouldn't be do bad)

In 1.21 there are impl<'a, T> From<&'a [T]> for Rc<[T]> which would make it possible to use a Rc pointer instead but that's the closest.

Maybe I am forgetting something but I don't think there is a way to construct a variable sized Rc<[u8]> without that constructor?

Oh I was going to say you can convert it from Box but you're right, that conversion was also added only in 1.21... I suppose it's up to @BurntSushi then.

Re-ran the benchmarks on just the unsafe addition and there were only a ~1% speedup so I removed it. Using double indirection + Arc (Rc can't be used as it isn't Send) gave a slight performance degradation instead so that isn't viable either.

Ah, that's even better news.

Ping @BurntSushi (unsafe is removed losing only a small bit of the overall improvement)

@Marwes Does this still give 2x memory saving after the unsafe removal?

Does this still give 2x (?) memory saving after the unsafe removal?

No, State { data: Box<[u8]> } is stored twice just as before this PR.

Hmm, maybe it's worth using Rc then after all? It was kind of nice improvement...

Actually, Arc/Rc requires two extra usize per state. I have not idea how large each State is, but if they are normally in the 16 bytes range the extra constant overhead might actually make it worse.

Is Arc as opposed to Rc really needed there? Isn't owning struct already accessed via thread-safe wrapper? If so, this would just add unnecessary overhead.

@RReverser You still need a Send bound, which is required by thread_local. I don't know off hand what it would take to drop the Send requirement here. It's been a while since I've sunk my head into thread_local.

Yeah, it is a bit odd that a therad local value needs Send but it seems like thread_local allows iterating over the the values of all the threads https://amanieu.github.io/thread_local-rs/thread_local/struct.ThreadLocal.html#method.iter_mut

@BurntSushi This ought to be good now.

Ping @BurntSushi

@Marwes Yes, I know I'm on the hook for this. It's going to take me some time to get around to merging it.

:umbrella: The latest upstream changes (presumably a3bccb131d32acc377232a447e44a2c6c71229bc) made this pull request unmergeable. Please resolve the merge conflicts.


JEmoji does not show properly

Hello and thanks for making this beautiful theme :)
I'm using the lastest master snapshot and put the jemoji gem under the _config.yml file.
The problem is about the emoji renderization, as you can see there:

The emojis shown above are:
:grin:
:smiley:
:octocat:

Thanks for this @leskuore sorry for the belated answer, going trough issues this week and updating the theme.


Tech debt: add from __future__ import annotations in the Tracing feature

Why is this needed?
Reference: https://github.com/aws-powertools/powertools-lambda-python/issues/4607
Add from future import annotations to all files, including examples
Which area does this relate to?
Static typing
Solution
No response
Acknowledgment

[X] This request meets Powertools for AWS Lambda (Python) Tenets
[ ] Should this be considered in other Powertools for AWS Lambda languages? i.e. Java, TypeScript, and .NET

Closed as complete.


proposal: Integrate with beyondstorage/go-storage to add multiple storage backend supports

Background
BeyondStorage is an open-source community focused on providing cross-cloud, no vendor lock-in data services. And go-storage is a storage abstraction that can operate the data across different storage services like s3, gcs, azblob, oss, even ipfs. Service Integration Tracking records the updates.
zot is cool but lacking different storage backends support (as far as I know).
Proposal
So I propose to integrate zot with beyondstorage/go-storage to add multiple storage backend supports.

Add config support

we have rootDirectory for now, maybe we can support add a new field or allow connection string here like:
"rootDirectory": "s3://bucketname/path"

Migrate I/O operations to go-storage

Thanks for reading and any comments are welcome!

@Xuanwo thanks for bringing go-storage [1] to our attention. We will look at it.
Our solution to remote storage has been to use fuse drivers [2].
[1] https://github.com/beyondstorage/go-storage
[2] https://github.com/anuvu/zot/issues/179

@Xuanwo just to add, we recently added support for multiple subpaths (and by extension multiple storage backends) [1]
[1] https://github.com/anuvu/zot/blob/master/examples/config-multiple.json#L7

@Xuanwo would the go-storage project [1] have any benchmarking numbers etc comparing and contrasting with s3fs-fuse project [2]?
References:
[1] https://github.com/beyondstorage/go-storage
[2] https://github.com/s3fs-fuse/s3fs-fuse

We will have a benchmark on this case.

We tested the overhead of go-storage versus native SDK (we reach this tests via implement a service with no-op), the result shows that our abstriction adds up to 20ns/op. (PR https://github.com/beyondstorage/go-storage/pull/685)
goos: linux
goarch: amd64
pkg: github.com/beyondstorage/go-storage/v4/tests
cpu: Intel(R) Core(TM) i7-8650U CPU @ 1.90GHz
BenchmarkStorage_Stat
BenchmarkStorage_Stat-8   	45983168	        21.99 ns/op
PASS

So we can treat go-storage as nearly the same as using native SDK directly.
Both s3fs-fuse and goofys are built upon native SDK with the abstriction of POSIX alike API, they must be much slower than using native SDK.
If there is a need to real benchmarking numbers, we will set up an env that write/read/list files via go-storage and fuse for a bench.
What's your idea about that?

@Xuanwo for our container builds use case (in production), we serve a parallel mix of small/large sizes of read/write workload. It would be great if we can get a sample app using go-storage project with results similar to this [1].
Also noticed, you are working on improving your code coverage [2] and couldn't find anything about running lint [3] in your ci/cd pipeline.
References:
[1] https://docs.openstack.org/developer/performance-docs/test_results/container_repositories/registry2/index.html
[2] https://codecov.io/gh/beyondstorage/go-storage/branch/master
[3] https://github.com/golangci/golangci-lint

We are making progress on this issue with PR #216.
We can re-evaluate once beyondstorage/go-storage code quality becomes provably higher.


HTTP client can not data-bind CSV response into a Ballerina record

Description:

$subject

Consider following code:
type XeResponse record {
    float amount;
};

http:Client xeClient = check new("https://xecdapi.xe.com/v1", auth = ...);
XeResponse xeResponse = check self.xeClient->/convert_from\.csv\/(
    'from = fromCurrency,
    to = toCurrency,
    amount = amount
);

XE Currency convertor API [1] used in the above code returns a CSV response in following format;
Terms,https://www.xe.com/legal/,Privacy,http://www.xe.com/privacy.php
from,amount,timestamp,quotecurrency,mid
USD,10.0,2024-06-07T00:00:00Z,GBP,12.345

[1] - https://xecdapi.xe.com/docs/v1#/Mid-market Rates/get_v1_convert_from
But the Ballerina code throws a data-binding error.

ATM we dont support data binding for csv type right?

Yes, for this to support we need a csv parser. May be we could support this once the ballerina/data.csv package is published.(https://github.com/ballerina-platform/module-ballerina-data.csv)


ValueError: The samples by features table 'y' must be nonnegative

I am using the function cca(X,y) to perform canonical correspondence analysis.
When calling the method, I get the following error:
ValueError: The samples by features table 'y' must be nonnegative.
Yet when I call y.min() the lowest value is positive.
Can this be a possible bug in the implementation?
This is using both scikit-bio 0.4.2 and 0.5.1.

@prubbens checking the documentation, the function is def cca(y, x) not cca(X, y) so you have just got your order mixed up. Reversing them should fix the problem.

Alternatively, you named your features table 'X' but that is where you should check for nonnegative values.

@prubbens reopen if this has not bee addressed


Client SDK source repository?

Not only related to iOS but other platforms too, could not find any other place to ask.
I'm struggling to find the actual source repositories of client SDKs. Do they exist?

The SDKs are closed source, sorry!

Yikes.
If you don't mind me asking, what could possibly be gained in using a closed client for a hosted service? How do you propose third-party client libraries reliably implement the protocol if it's closed?

I guessing they will have to restart there account
Sent from my MetroPCS 4G LTE Android device
On Aug 10, 2016 06:03, Alexander Bolodurin<EMAIL_ADDRESS>wrote:Yikes.
If you don't mind me asking, what could possibly be gained in using a closed client for a hosted service? How do you propose third-party client libraries reliably implement the protocol if it's closed?
—You are receiving this because you are subscribed to this thread.Reply to this email directly, view it on GitHub, or mute the thread.


Data Acquisition

Hi guys,
If you need the data, please leave your valid email address, and I'll send it to you when I'm free. For the augmented data, you can obtain it yourself using the instructions provided in README.
With best wishes.

<EMAIL_ADDRESS>thanks!

<EMAIL_ADDRESS>thanks!

<EMAIL_ADDRESS>Thanks!


Schedule release candidate CI workflow picks up commits with failed checks

What happened?
https://github.com/iree-org/iree/actions/runs/3469376607/jobs/5796297215
picked a failing commit (https://github.com/iree-org/iree/commit/3ff9d517054313a63d20012dcf9510e307915df1) as the "last green commit"
The code to pick up the commit is at https://github.com/talentpair/last-green-commit-action/blob/d95cfa836b22ef047dd0a8ddb1e6d9567982d702/src/main.ts#L34
GitHub REST api returns the check_suites via https://docs.github.com/en/rest/checks/suites#list-check-suites-for-a-git-reference
In the example above, it returns a list of check_suites with 13 checks, and some of them are with status queued and some of them are with the status completed
https://api.github.com/repos/iree-org/iree/check-suites/9307573321
https://api.github.com/repos/iree-org/iree/check-suites/9316620900
Steps to reproduce your issue
No response
What component(s) does this issue relate to?
Other
Version information
No response
Additional context
No response

It could be more complicated than that.
If I query https://github.com/iree-org/iree/commit/3ff9d517054313a63d20012dcf9510e307915df1 with
https://api.github.com/repos/iree-org/iree/commits/3ff9d517054313a63d20012dcf9510e307915df1/check-suites

And print out the name of the check_suite list and their status/conclusion
Google CLA
  status:queued
  conclusion:None
Dependabot
  status:queued
  conclusion:None
Buildkite
  status:queued
  conclusion:None
GitHub Pages
  status:queued
  conclusion:None
GitHub Actions
  status:completed
  conclusion:failure
GitHub Actions
  status:completed
  conclusion:success
GitHub Actions
  status:completed
  conclusion:success
GitHub Actions
  status:completed
  conclusion:success
GitHub Actions
  status:completed
  conclusion:success
GitHub Actions
  status:completed
  conclusion:success
GitHub Actions
  status:completed
  conclusion:success
GitHub Actions
  status:completed
  conclusion:success
GitHub Actions
  status:completed
  conclusion:success

If the flow changed from Any to All we may not find any usable commit if they are not the native GH actions.

If instead check-runs is called via REST API
https://api.github.com/repos/iree-org/iree/commits/3ff9d517054313a63d20012dcf9510e307915df1/check-runs

Then
publish_website
  status:completed
  conclusion:success
Publish release
  status:completed
  conclusion:success
Validate packages
  status:completed
  conclusion:success
Invoke workflow to validate and publish release
  status:completed
  conclusion:success
macos :: Build py-runtime-pkg Package
  status:completed
  conclusion:success
macos :: Build py-compiler-pkg Package
  status:completed
  conclusion:success
linux :: Build py-tf-compiler-tools-pkg Package
  status:completed
  conclusion:success
linux :: Build py-runtime-pkg Package
  status:completed
  conclusion:success
linux :: Build py-compiler-pkg Package
  status:completed
  conclusion:success
linux :: Build main-dist-linux Package
  status:completed
  conclusion:success
generate_report
  status:completed
  conclusion:success
Advance iree-mhlo-fork
  status:completed
  conclusion:success
Advance iree-llvm-fork
  status:completed
  conclusion:success
Advance iree-tf-fork
  status:completed
  conclusion:success
Advance iree-mhlo-fork
  status:completed
  conclusion:success
Advance iree-llvm-fork
  status:completed
  conclusion:success
Advance iree-tf-fork
  status:completed
  conclusion:success
benchmark_cuda
  status:completed
  conclusion:success
benchmark_cpu
  status:completed
  conclusion:success
setup
  status:completed
  conclusion:success
Advance iree-tf-fork
  status:completed
  conclusion:success
Advance iree-mhlo-fork
  status:completed
  conclusion:success
Advance iree-llvm-fork
  status:completed
  conclusion:success
summary
  status:completed
  conclusion:failure
test_benchmark_suites (host, x86_64, gcr.io/iree-oss/base@sha256:7c3027c48b94fc38e64488987fc7893c...
  status:completed
  conclusion:success
test_benchmark_suites (riscv, rv32-linux, gcr.io/iree-oss/riscv@sha256:cd2ee29950737f44b5ec54a32c...
  status:completed
  conclusion:success
test_benchmark_suites (riscv, rv64, gcr.io/iree-oss/riscv@sha256:cd2ee29950737f44b5ec54a32c37746e...
  status:completed
  conclusion:success
benchmarks / build_tools (riscv, rv64, gcr.io/iree-oss/riscv@sha256:cd2ee29950737f44b5ec54a32c37746e951fc74ef2...
  status:completed
  conclusion:success
benchmarks / build_suites
  status:completed
  conclusion:success
test_shark_model_suite
  status:completed
  conclusion:skipped

We may be able to distill the green commit with check_runs["name"] == "summary" && check_runs["status"] == completed && check_runs["conclusion"] ==  "success"

Oh God it's listing every possible check suite a commit could have 🤦

https://github.com/iree-org/iree/releases/tag/candidate-20221116.329 picked up a not-so-green https://github.com/iree-org/iree/commit/be18b66ea5d71dfed513cf98e5e52c5f09d7deaf again 😢
https://api.github.com/repos/iree-org/iree/commits/be18b66ea5d71dfed513cf98e5e52c5f09d7deaf/check-suites
https://api.github.com/repos/iree-org/iree/commits/be18b66ea5d71dfed513cf98e5e52c5f09d7deaf/check-runs?check_name=summary

Manually kicked off the workflow and it correctly picked the commit two behind head because the latest two were still running CI: https://github.com/iree-org/iree/actions/runs/3842646848/jobs/6544142849