Update Kafka to 1.0.0

Kafka 1.0.0 was released in November, 1, so I decided to brush up the RPM spec:

Added systemd unit for CentOS/RHEL 7 support.
Improved Kafka dependencies list: remove jdk8 package, use java-devel instead. It might be useful for those people, who want to use OpenJDK as a main JDK during on building process.
Changed offsets.topic.replication.factor from 2 to 1 because we should try to minimize the configuration steps by default. Offsets replication factor 2 means that you have to have at least 2 nodes of Kafka's in your cluster to keep up an offsets of partitions.
Changed zookeeper.connect from localhost:60182 to localhost:2181 to the default Zookeeper port. We still need to have a Zookeeper installed before starting use Kafka, but the default port is easy to recognize.

Thanks for your contribution!

I found an issue of memory leak in Apache Confluence in Kafka 1.0.0 (https://issues.apache.org/jira/browse/KAFKA-6185). Maybe we should wait release 1.1.0 or apply patch, that have been already merged to trunk branch (https://github.com/apache/kafka/pull/4193).

I think it better to wait for 1.0.1 release which also contains fixes for other important bugs.

@gongled Could you please merge your branch with the latest version of develop branch? It must fix a problem with TravisCI checks.

Kafka 1.0.1 has been finally released with the fix that we are waiting for so long. However, I want to inform you that I have not tested upgrade yet. I suggest to check it and then include the following package to the next release.

@andyone, I've checked installation and upgrade procedure from 0.11.0 to 1.0.1. At first glance, it works properly. Could you build and publish new package to kaos-testing?

@gongled Because of a massive number of commits in this PR, I decided to add all these changes as single commit (7afacc73968c7c9c3b3e1bb3cc5bc249440b0917) to develop branch.

I have added kafka-1.0.1 to kaos-testing repository. I'll release this package as part of #180
If you find some problems with the spec or configs, please create new PR from develop branch. It will be much easier to review changes to me.


Pass proper namespace while collecting pods info

Currently we do not pass namespace while collecting pods data. It generates empty pod files. Based on controller-manager name in pod, set the proper namespace and then collect the logs.
As a pull request owner and reviewers, I checked that:

[x] Appropriate testing is done and actually running
[ ] Appropriate documentation exists and/or is up-to-date:

[ ] README in the role
[ ] Content of the docs/source is reflecting the changes

It is not working as expected.

Fixed here: https://github.com/openstack-k8s-operators/ci-framework/pull/252


npm start fails (gulp issue: Failed to load external module @babel/register)

After running npm start
I get :
> gulp server

[17:17:29] Failed to load external module @babel/register
[17:17:29] Requiring external module babel-register
gulp[80834]: ../src/node_contextify.cc:635:static void node::contextify::ContextifyScript::New(const FunctionCallbackInfo<v8::Value> &): Assertion `args[1]->IsString()' failed.
 1: 0x10003cf99 node::Abort() [/usr/local/bin/node]
 2: 0x10003bfbb node::AddEnvironmentCleanupHook(v8::Isolate*, void (*)(void*), void*) [/usr/local/bin/node]
 3: 0x1000674c2 node::contextify::ContextifyScript::New(v8::FunctionCallbackInfo<v8::Value> const&) [/usr/local/bin/node]
 4: 0x100242aaf v8::internal::FunctionCallbackArguments::Call(v8::internal::CallHandlerInfo*) [/usr/local/bin/node]
 5: 0x100241c4b v8::internal::MaybeHandle<v8::internal::Object> v8::internal::(anonymous namespace)::HandleApiCallHelper<true>(v8::internal::Isolate*, v8::internal::Handle<v8::internal::HeapObject>, v8::internal::Handle<v8::internal::HeapObject>, v8::internal::Handle<v8::internal::FunctionTemplateInfo>, v8::internal::Handle<v8::internal::Object>, v8::internal::BuiltinArguments) [/usr/local/bin/node]
 6: 0x100241667 v8::internal::Builtin_Impl_HandleApiCall(v8::internal::BuiltinArguments, v8::internal::Isolate*) [/usr/local/bin/node]
 7: 0x92b694dbe3d
 8: 0x92b6948d145
 9: 0x92b69509d9d
10: 0x92b694918d5
11: 0x92b694918d5
Abort trap: 6

Note : I've fixed the issue by downgrading gulp from 3.9.1 to 3.9.0
npm install<EMAIL_ADDRESS>

I have the same issue. Was following the guide https://forestry.io/blog/up-and-running-with-hugo/#4-customizing-your-theme.
`npm install was ok, but
npm start

><EMAIL_ADDRESS>start
> gulp server

[19:26:54] Failed to load external module @babel/register
[19:26:54] Requiring external module babel-register
gulp[8363]: ../src/node_contextify.cc:686:static void node::contextify::ContextifyScript::New(const v8::FunctionCallbackInfo<v8::Value>&): Assertion `args[1]->IsString()' failed.
 1: 0xa389b0 node::Abort() [gulp]
 2: 0xa38a2e  [gulp]
 3: 0xa2a8c3 node::contextify::ContextifyScript::New(v8::FunctionCallbackInfo<v8::Value> const&) [gulp]
 4: 0xc248d5  [gulp]
 5: 0xc24edf  [gulp]
 6: 0xc25506 v8::internal::Builtin_HandleApiCall(int, unsigned long*, v8::internal::Isolate*) [gulp]
 7: 0x1446459  [gulp]
Aborted

I did not alter downloaded package.json, which already contains gulp is on version "gulp": "^3.9.0",.


Refactor batch calls in EthereumClient

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

101 of 133 (75.94%)  changed or added relevant lines in 3 files are covered.
11 unchanged lines in 4 files lost coverage.
Overall coverage decreased (-1.08%) to 88.669%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

gnosis/eth/multicall.py
34
37
91.89%

gnosis/eth/ethereum_client.py
63
92
68.48%

Files with Coverage Reduction
New Missed Lines
%

gnosis/eth/oracles/oracles.py
2
89.29%

gnosis/eth/typing.py
2
83.33%

gnosis/safe/safe_tx.py
2
88.72%

gnosis/eth/ethereum_client.py
5
79.94%

Totals

Change from base Build<PHONE_NUMBER>:
-1.08%

Covered Lines:
2379

Relevant Lines:
2683

💛  - Coveralls


[V5.0.0] Add to winget-pkgs for easy installation and upgrades

winget is a Microsoft-developed open-source package manager for Windows, and its official repo (winget-pkgs) readily accepts PRs for new listings. It's fairly easy to author a manifest using winget-create or YamlCreate.ps1. Updating listings is also done through PRs, and can even be automated with CI.
With VRCFT's latest release coming with nice msix/appinstaller format, it'd be an easy addition to the repository, and more packages helps support a robust package management ecosystem on the Windows platform. It'd make installation as simple as running winget install BenacleJames.VRCFaceTracking

In progress

Done!


The initialization procedure of projection server may not working with rails plugins

I have a User model with Devise enabled. It can be loaded properly by rails server but not by the projectionserver. I found the initializer of Devise must be run before the User model is required. It seems that projection server is not running any initializers in the config folder. I could not find a way to get around this yet.

Your observation is correct. The projection server will not perform any initializers.
I have never tried to get something like Devise to run. But my approach would be to use it only on the Rails servers with the command "models". On the projection side everything is done already and should be part of the events.

Projection server and Rails server share the same model definitions and database. Did you suggest I need to decouple the User model with the other models and only load those models in projectionserver? But that will introduce additional overhead of keeping models separated.
My understanding is that the projection server is the "daemon" side of rails server, it realize the business logic part. They share the same resources, which brings the simplicity of this framework.

I cannot give you any advice, I simply have never tried it. I wish you good luck and I am keen to get to know whether you get it to work or not.
If you have to run some initializers in the projection server try it.


Bind ListBoxItem to object

Describe what feature you'd like. Pseudo-code, mockups, or screenshots of similar solutions are encouraged!
I got into the following scenario. I wanted to bind ListBoxItem to object value extracted from the localStorage. It worked good at first look, but on page refresh it doesn't mark as active the last selected list item (the object value from the localStorage).
Object binding to  ListBoxItem might be a good in specific cases.
Minimal example
<script>
	import { ListBox, ListBoxItem } from '@skeletonlabs/skeleton';
	import { writable } from 'svelte/store';
	import { browser } from '$app/environment';

	// Store init
	const data = browser && JSON.parse(window.localStorage.getItem('test') || '{ "value": "" }');

	export const testStore = writable(data);

	testStore.subscribe((value) => {
		if (browser) {
			localStorage.setItem('test', JSON.stringify(value));
		}
	});

	// List of objects
	let listValues = [{ value: 'Books' }, { value: 'Movies' }, { value: 'TV' }];
</script>

<ListBox>
	{#each listValues as item}
		<ListBoxItem name="medium" value={item} bind:group={$testStore}>{item.value}</ListBoxItem>
	{/each}
</ListBox>

What type of pull request would this be?
New Feature
Any links to similar examples or other references we should review?

https://dmitripavlutin.com/how-to-compare-objects-in-javascript
https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Object/is

It's mentioned in the thread above, but I want to emphasize that the fix will likely involve implementing the Object.is() syntax for object comparison per:
https://dmitripavlutin.com/how-to-compare-objects-in-javascript/

@endigo9740 just tested the Object.is() option and it is not working because it will compare the objects by reference.
I want to build a simple deep comparison function that compares any type of prop (not only objects but also numbers and strings etc...) does it sound good?


IsRunning not set to false when stop method is called

The IsRunning property is not set to false when the stop method is called.
So the IsRunning property is not valid.

I'll fix it today

Fixed

Thank you! Keep up the good work


LitSuggest data curation

Description
I've been testing the LitSuggest tool from NCBI as a discovery tool for new datasets to include in the HCA. This tool performs a weekly selection of published literature available at PubMed, that needs to be manually curated.
Documents

LitSuggest weekly digest (Jan 10 2022 to Jan 16 2022)
Curated spreadsheet

To do

[ ] Curate the list of positive literature of the weekly digest from Jan 10 2022 to Jan 16 2022 (70/340)

The LitSuggest tool was fed eligible and non-eligible from Ingest in order to train a specific network - it then searches through pubmed and provides a weekly digest of what it thinks is eligible and non-eligible.
Irene is curating what it thinks is eligible, and checking if it is or is not, and then will probably feed back into LitSuggest to further increase it's accuracy.
Help with curating the LitSuggest weekly digest would be great.

Irene working through it with 5 - 10 datasets a day.

@ipediez created a poll to have a discussion about NLP and how this litsuggest curation works

Rather than Stalled, no-one is actively working on this. Either we move it to the Backlog or we close it. But being in stalled does not make sense to me. It's simply not being worked on. @gabsie any thoughts?

at this point in time our wrangling is very dependent on what the bionetworks select for the atlas so we are not focusing on discovering more datasets
I'm closing this ticket since it's not needed


Not working when it is nested inside a ScrollView?

I am currently testing out this lib. Great work by the way, but it doesn't seem to work when nested inside a ScrollView.
It works fine without parent ScrollView though.
My use case is that there are multiple sortable lists in one screen divided into different sections.

@joonhocho Did you ever find a solution to this issue? I'm having the same problem.

@danleveille  I'm sorry, but no. I ended up using one sortable list per screen for the time being.

Hey @joonhocho, sorry for the VERY late reply. This probably won't work. You could potentially track when the drag begins / stops and set scrollEnabled={false} on the parent ScrollView? However, the parent scroll view won't automatically scroll if this does work.

Hello there,
I am trying to render sortable list as below code but it just doesnt scroll . can you please let me know what wrong i am doing
render: function() {
return (
<NavigationBar title={{title:'Submit Buddy score', tintColor:'white'}}/>
      <SortableListView
      style={{flex: 1}}
      data={data}
      order={order}
      onRowMoved={e => {
        order.splice(e.to, 0, order.splice(e.from, 1)[0]);
        this.forceUpdate();
        console.log(order);
      }}
      renderRow={row => <RowComponent data={row} />}
    />

      </View>)

},

Hello there,
Scroll is not working if i nest the  scrollable list within a view.

A couple tricks I used to get around this issue for different use cases are:
1- Using a ListView header renderHeader={() => this.props.header}
2- Pressing an Edit button would change the original view into this component and hide everything else (including the original scrollview)

Thanks @TheSisb. This kind of functionality would need some serious changes to the code, and a lot of thought. Would adding section support to the scrollview achieve this? And preventing drag / drop between sections?

For case #1 (header), I do it in my fork here: https://github.com/hammerandchisel/react-native-sortable-listview/blob/master/index.js
For case #2 - I don't think it's the responsibility of this lib to handle.  The user's app should handle it.
It would be cool if this lib prevented drag/drop between sections 👍 .  Right now on edit, I simply hide everything except the editable (drag/drop) items.

I think I am just going to make it so that there are two sections, each with a header and their own sortable-listview but only one section can be open at a time. Not a perfect solution but that way there is only ever one scrollable area at a time, and each has a header. Opening one will cause the other to close, etc.

This also doesn't appear to work when its nested inside any type of nested view.


How Data can be Dynamic in Table like ?

How Data can be Dynamic in Table like ?
In Current Example, Data is coming thru PersonData which is a single model, What if I am using this table as plugin or shared component and data can come from one model on click of one link and if i click on 2nd link, then the data can come from different model/datasource. Is there any generic  kind of implementation for data's?

You could implement a generic interface and have the table bind to interface properties. This will work if you can model your data with a single interface.
Otherwise you'll probably need to use reflection or something of the sort.


[DO NOT MERGE] Attempt to follow pep8 ruels

I try to make as few errors as possible under the command
pycodestyle --statistics --ignore=E501  ./skwdro/
(and correct some of them with autopep8 --in-place --aggressive file.py

Next step is to check warnings with pyflakes

Considering the fact that I may or may not have over-typed my part of the code, mypy might be an option as well.
I think this issue is rather important for the maintainability of our codebase.

(As a personnal note, I would consider replacing flake8 by Ruff, even in my personal configs.)

The tests now pass, and the files show no warning through both ruff and pycodestyle.
Exceptions:

rho tuning and its computations files.
specific solvers file.
All the E501 linebreaks warnings.

See pyproject.toml on the relevant sections.
I believe the code is now mergeable


Slow unit test with _enan.py

We experience several (not all) cases of test_enan.py being very slow. By reading the code, I am thinking whether such a patch is still needed in 2024. @mortonjt
https://github.com/scikit-bio/scikit-bio/blob/main/skbio/metadata/_enan.py

Hello Qiyun, I recently started experiencing this as well. However, I believe the testcase slowing down the operation is in class LotsaTestCase(unittest.TestCase): since running make test on my local (MacOS, Apple Silicon) system is fine even after test_enan.py is complete. It encounters LotsaTestCase and remains stuck for 2-3 minutes. https://github.com/scikit-bio/scikit-bio/blob/0adae8f041b42c19f6c58eba7a10306aab9f725c/skbio/metadata/tests/test_intersection.py#L116-L166

@aryankeluskar Thank you for analyzing this! It is valuable information. @mortonjt

This test causes segmentation fault after long pause in some old software environments.

@mataton and I found the reason. It is related to #2061. We found a fix.


timesync error between px4 and mavros [simulation]

Hi,
When I run the two following commands in two different terminals the simulation works without errors.

no_sim=1 make posix_sitl_default gazebo (this runs px4)
roslaunch gazebo_ros empty_world.launch world_name:=$(pwd)/Tools/sitl_gazebo/worlds/iris.world

But when I run this third command in a third terminal, I get "ERROR [mavlink] [timesync] Hard setting offset." in the terminal running px4.
3. roslaunch mavros px4.launch fcu_url:="udp://:14540@<IP_ADDRESS>:14557"
In the mavros terminal I get this error: "[ WARN] [1527786373.403793887,<PHONE_NUMBER>00]: TM: Clock skew detected (-0.013114400 s). Hard syncing clocks."
I'm running Ubuntu 16.04, with rosdistro: kinetic, with px4 v1.7.3.

This error is normally a result of poor computer performance. Secondly, why are you launching all of these separatly instead of using the launch file px4 comes with to do all of this?

Thanks lamping7,
It should indeed be a result of poor computer performances. Nevertheless the good point is that everything is working and communicating (gazebo, ros, px4) except that I get in addition these warnings.
I am launching separately the gazebo ros and px4 processes in order not to relaunch everything if I just did some modifications in px4. And thus I only re-run the px4 process (keeping gazebo opened, indeed gazebo is quite slow to open on my computer).

If you update to latest mavros and latest PX4, you might not get these warnings, since the timesync was improved to work on worse links.

I am working with the latest mavros but with PX4 v1.7.3
When was the commit to remove these warnings ?

This is not from latest mavros :
"[ WARN] [1527786373.403793887,<PHONE_NUMBER>00]: TM: Clock skew detected (-0.013114400 s). Hard syncing clocks."

PX4 timesync : https://github.com/PX4/Firmware/pull/9365
Mavros timesync : https://github.com/mavlink/mavros/pull/1042

Hi,
would you help such issue I met on PX4?
If HEARTBEAT got before, and timesync one time success, everything is OK.
But if I manually change the linux systime  on my local system, then everything block suddenly after once HEARTBEAT received.
I had tried the lastest Mavros timesync : mavlink/mavros#1042, it do not work, same result.


Still alive

Hello,
is this project still maintained?
Thank you
Jan Opravil

Anyone?

what is an alternative to this package?   Seems abandoned, so will have to update current projects.

I forked this repo and replaced pg-ipc with pg-listen
So now it will retry the connection to postgres.
https://github.com/originlabs/graphql-postgres-subscriptions

I forked this repo and replaced pg-ipc with pg-listen
So now it will retry the connection to postgres.
https://github.com/originlabs/graphql-postgres-subscriptions
Published to npm as @originlabs/graphql-postgres-subscriptions-retry

hi @Jonahss
i have tried your fork but the pubsub never get connected.
no problem with the original package tho.

Hi @raymclee
If you send me sample code of your use-case I could take a quick look to see what could be wrong.
If you're using the asyncIterator, you have to pass in a list of topics in the constructor, that could be it.
I'm using my fork in production, so works for my case, but I'd be happy to fix any issues to work for your case.

Hi @Jonahss, just tried again with topics added and it works!
not sure why it was not working last time. i think i have added the list of topics to constructor also.

Awesome!
Yeah, I did the work pretty quickly, so had to make that requirement. It
feels a little awkward, but I didn't want to change the interface too much,
so that it's almost a drop-in replacement. If you want to dynamically add
new topics, we might have to re-work it.
On Tue, Apr 20, 2021 at 6:00 AM raymclee @.***> wrote:

Hi @Jonahss https://github.com/Jonahss, just tried again with topics
added and it works!
not sure why it was not working last time. i think i have added the list
of topics to constructor also.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/GraphQLCollege/graphql-postgres-subscriptions/issues/18#issuecomment-823254189,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AALTRMM6U4LF3I6Z7U75AKDTJV3HVANCNFSM4IFRGWCA
.

@Jonahss Thanks a ton for this. Saved my bacon today after I thought I got a feature done with plenty of time for a demo tomorrow only to find that the AWS load balancer was destroying my websocket usage when deployed to the hosted environment. Then I found this repo and it's so out of date that nothing worked. Figured I was done for until I found your fork. Worked great. Thanks!
PS - I did run into the same issue as raymclee above. Had to come up with a work around because I was indeed using dynamic topics. My current implementation isn't the greatest because I just moved the dynamic bit to the payload and the client now receives all the payloads under that topic and then filters off of the value. When I have more time I'll try to PR in some dynamic topic support to your fork.

Hey sweet! Thanks for the shoutout :D Happy that more people are able to
get graphql postgres subscriptions working.
A nice solution to dynamic topics would be great.
On Thu, Aug 25, 2022 at 10:24 AM Chev @.***> wrote:

@Jonahss https://github.com/Jonahss Thanks a ton for this. Saved my
bacon today after I thought I got a feature done with plenty of time for a
demo tomorrow only to find that the AWS load balancer was destroying my
websocket usage when deployed to the hosted environment. Then I found this
repo and it's so out of date that nothing worked. Figured I was done for
until I found your fork. Worked great. Thanks!
PS - I did run into the same issue as raymclee above. Had to come up with
a work around because I was indeed using dynamic topics. My current
implementation isn't the greatest because I just moved the dynamic bit to
the payload and the client now receives all the payloads under that topic
and then filters off of the value. When I have more time I'll try to PR in
some dynamic topic support to your fork.
—
Reply to this email directly, view it on GitHub
https://github.com/GraphQLCollege/graphql-postgres-subscriptions/issues/18#issuecomment-1226878097,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AALTRMLPEGNOLLYXE3PFQFTV24NS7ANCNFSM4IFRGWCA
.
You are receiving this because you were mentioned.Message ID:
@.***
.com>


Add type DelegateContractId

Problem
SDK currently do not support this type that is needed for contracts.
Solution
Add support
Alternatives
No response

Implemented this type and released.

@gregscullard I'm not completely sure on what is being said to be honest. At the moment both ContractId and hence DelegateContractId extend Key


SARAALERT-1100: Allow editing of Exposure Info in the Isolation Workflow

Description
Jira Ticket: SARAALERT-1100
This is a follow up of the work done by @dubem7 in this PR.
(Feature) Demo/Screenshots
Isolation Workflow (volume up)
https://user-images.githubusercontent.com/35042815/128190255-a4b13b81-440a-4100-ab2a-e4078a7163e7.mov
Exposure workflow remains the same aside from the removal of the "Previous" button in the wizard.
Important Changes
Please list important files (meaning substantial or integral to the PR) along with a list of the general changes that should be highlighted for reviewers.
Broke out Exposure.js component into three new components to support having both Case and Exposure information available in the enrollment wizard: Enrollment.js, CaseInformation.js, ExposureInformation.js, Patient.js
Added test files for new Enrollment wizard components: CaseInformation.test.js, ExposureInformation.test.js
Hide the previous button in the carousel after the first pass when enrolling: Enrollment.js, CaseInformation.js, ExposureInformation.js, Contact.js, Review.js
Refactored and renamed edit mode variables in the carousel to just be props and match the rest of the app: Contact.js
Fixed styling on edit links in monitoree details section to match enrollment review page: Patient.js
Added new blank mock patients (one for exposure and one for isolation): Address.test.js, Contact.test.js, Identification.test.js, Patient.test.js, CaseStatus.test.js, mockPatients.js
Testing Recommendations
Enroll and edit in both workflows to make sure nothing is wonky
Checklists
Submitter:

[x] This PR describes why these changes were made.
[x] This PR is into the correct branch.
[x] This PR includes the correct JIRA ticket reference.
[x] Comment added to the relevant JIRA ticket(s) with a link to this PR
[x] Code diff has been reviewed (it does not contain: additional white space, not applicable code changes, debug statements, etc.)
[x] If UI changes have been made, Chrome Dev Tools Lighthouse accessibility test has been executed to ensure no 508 issues were introduced.
[x] Tests are included and test edge cases
[ ] Tests have been run locally and pass (remember to update Gemfile when applicable)
[ ] Test fixtures updated and documented as necessary

@tstrass :

[ ] Code is maintainable and reusable, reuses existing code and infrastructure where appropriate, and accomplishes the task’s purpose
[ ] The tests appropriately test the new code, including edge cases
[ ] You have tried to break the code
[ ] If applicable, you have tested changes against a large database, and considered possible performance regressions
[ ] Tested all recommendations listed in the "Testing Recommendations" section. The application behaves as expected with this PR.

@timwongj :

[ ] Code is maintainable and reusable, reuses existing code and infrastructure where appropriate, and accomplishes the task’s purpose
[ ] The tests appropriately test the new code, including edge cases
[ ] You have tried to break the code
[ ] If applicable, you have tested changes against a large database, and considered possible performance regressions
[ ] Tested all recommendations listed in the "Testing Recommendations" section. The application behaves as expected with this PR.

@hackrm :

[ ] Code is maintainable and reusable, reuses existing code and infrastructure where appropriate, and accomplishes the task’s purpose
[ ] The tests appropriately test the new code, including edge cases
[ ] You have tried to break the code
[ ] If applicable, you have tested changes against a large database, and considered possible performance regressions
[ ] Tested all recommendations listed in the "Testing Recommendations" section. The application behaves as expected with this PR.

One point of feedback I have - When enrolling a Case with text in the Case Info notes field, I find it confusing that those notes display under the "Exposure Information" section. If displayed this way, users may incorrectly think they have to edit the "Exposure Inforamtion" section in order to edit the note. Could this view be updated in a way to avoid that possible confusion? Perhaps have the note display under the "Case Info" section when the monitoree is a case?

One point of feedback I have - When enrolling a Case with text in the Case Info notes field, I find it confusing that those notes display under the "Exposure Information" section. If displayed this way, users may incorrectly think they have to edit the "Exposure Inforamtion" section in order to edit the note. Could this view be updated in a way to avoid that possible confusion? Perhaps have the note display under the "Case Info" section when the monitoree is a case?

This was a great catch.  Talked with @hackrm offline about modifying the monitoree details display to be less confusing and the resulting changes were added here: https://github.com/SaraAlert/SaraAlert/pull/1027/commits/6729c540b5c62c776a59e35ef68d0f55d2ec04e7


back-gradient optimization technique

Hello!
I have a question about back-gradient optimization technique. Your paper mentioned this article, but reading the source code train_distill_image.py, I've noticed that you couldn't use SGD with momentum (because of previous learning rates influence), and so had to save neural network parameters of each forward step. So what is advantage of your scheme over usual backpropagation?

These are two different issues though.

Re momentum: There is nothing in our paper's framework that prevents using momentum. One just need to add the forward and backward logic. Momentum is computed independent of learning rate.
Re backgradient vs backprop: The literature has been using back-gradient to refer to backpropagation though optimization steps, often done with jvps. So there is not a difference between back-gradient and backprop though optimizations steps. The article you cited is just an instance of this technique, with improvements to make it more numerically stable by exploiting momentum. Of course you can also use autograd/autodiff systems to do so. It's just the common jvp technique makes it more efficient.


Disabling Desktop mode blocks LGS settings

I'm using Aurora 0.6.1-dev2 with a Logitech G410 keyboard. When I disable desktop mode in Aurora, my LGS settings doesn't show up on my keyboard (The keyboard stays black).
So, I decide to put the "Show default lightning(CUE, LGS, etc) when Desktop is disabled" option on.
However, when I enable this option, Aurora custom profiles don't work anymore.
I tried this on Skyrim (custom made) and Borderlands 2 (integrated).
The only way I found to fix this issue is to disable this option and go in the LGS lightning settings.
Is there a way to prevent Aurora from blocking LGS settings when Desktop mode is disabled without blocking other custom profiles ?
Thank you in advance for your answer.

I just tried to replicate your issue using 0.6.1-dev2 and the current dev branch and couldn't replicate it on either using Borderlands 2 and Spotify as a custom profile. Could you provide your latest log file on the day where you've replicated this issue? I have a feeling it may be an issue with re-initializing Logitech integration.

Here is my log file : https://pastebin.com/zTtSc14J
To simplify the issue, the problem I found is : when I disable desktop mode in Aurora, my keyboard doesn't use LGS default profile.
And the "Show default lightning(CUE, LGS, etc) when Desktop is disabled" option disables every Aurora custom profile.

From your log, it shows that Logitech integration is being disabled and enabled properly, but for some reason, it isn't working. With "custom profiles don't work" what do you see on your keyboard and in Aurora (UI and the Debug window)?

I noticed that the issue occured because I was using "Foreground app scan" instead of the default "Windows event" in the "Application Detection Method" setting...
When I switch back to the default option, Aurora works perfectly fine.
I switched to this mode because Borderlands 2 profile was not reading life and shield data in a multiplayer game, however, it caused more problems than expected.
To answer to your question, lights appeared on the keyboard when I edited the profile but they didn't when I launched the game.
I'm sorry I caused you some worries on this issue, it's just due to my carelessness.
Keep up the good work !

Well, thanks for telling me about that because it seems the Foreground app scan is broken. I'm going to close this issue because it is resolved, however, I'm going to go fix the Foreground app scan.


/usr/bin/env: bad interpreter: Text file busy

After a while I'm getting this error:
SUDO_MOUNT=1 USE_SYS_UTILS=1 ./conty_lite_lz4.sh ls
bash: ./conty_lite_lz4.sh: /usr/bin/env: bad interpreter: Text file busy

(This is after trying playonlinux, which failed to download anything, thought the gui came up) :
chronos@localhost /usr/local $ SUDO_MOUNT=1 USE_SYS_UTILS=1 ./conty_lite_lz4.sh playonlinux
Using system squashfuse and bwrap
Using regular mount command (sudo mount) instead of squashfuse
Running Conty

Looking for python... 3.9.2 - skipped
Looking for python2.7... 2.7.18 - wxversion(s): 3.0-gtk3
/usr/lib64/python2.7/site-packages/wx-3.0-gtk3/wx/_core.py:16629: UserWarning: wxPython/wxWidgets release number mismatch
  warnings.warn("wxPython/wxWidgets release number mismatch")
selected
/usr/lib64/python2.7/site-packages/wx-3.0-gtk3/wx/_core.py:16629: UserWarning: wxPython/wxWidgets release number mismatch
  warnings.warn("wxPython/wxWidgets release number mismatch")
/bin/sh: line 1: xrdb: command not found
1
[main] Message: PlayOnLinux (4.3.4) is starting
[clean_tmp] Message: Cleaning temp directory
[POL_Config_Write] Message: Config write: VDRIVES_LINK_MADE TRUE
[Check_OpenGL] Warning: check_dd_x86 missing, test skipped
[Check_OpenGL] Warning: check_dd_amd64 missing, test skipped
[POL_System_CheckFS] Message: Checking filesystem for /home/chronos/user/.PlayOnLinux/
[FS_Check] Warning: The following file is located on a noexec mounted filesystem.
It might prevent wine from working

/home/chronos/user/.PlayOnLinux/
[main] Message: Filesystem is compatible
[install_plugins] Message: Checking plugin: Capture...
[install_plugins] Message:    -->Installing plugin: 'Capture'.
[update_check] Message: Web version :<PHONE_NUMBER>
[update_check] Message: Current local version :
[update_check] Message: Updating list
[install_plugins] Message: Checking plugin: ScreenCap...
[install_plugins] Message:    -->Installing plugin: 'ScreenCap'.
[install_plugins] Message: Checking plugin: PlayOnLinux Vault...
[install_plugins] Message:    -->Installing plugin: 'PlayOnLinux Vault'.

(mainwindow.py:2669): Gtk-WARNING **: 22:12:58.674: Could not load a pixbuf from /org/gtk/libgtk/theme/Adwaita/assets/check-symbolic.svg.
This may indicate that pixbuf loaders or the mime database could not be found.
[POL_Config_Write] Message: Config write: LAST_TIMESTAMP<PHONE_NUMBER>
[POL_SetupWindow_Init] Message: Creating new window for pid 4526
[POL_SetupWindow_Close] Message: Closing window for pid 4526
rm: cannot remove '/home/chronos/user/.PlayOnLinux//install': No such file or directory
[POL_GPG_auth_script] Message: Checking signature of /home/chronos/user/.PlayOnLinux//install
[POL_GPG_install_key] Message: Importing PlayOnLinux public key
[POL_Bash] Message: POL GPG : Good signature - Microsoft Paint
[POL_SetupWindow_Init] Message: Creating new window for pid 4689
[POL_Wine_SelectPrefix] Message: Selecting prefix: mspaint
[POL_Wine_PrefixCreate] Message: Setting POL_WINEVERSION to 3.0.4
[POL_Wine_PrefixCreate] Message: Creating prefix (3.0.4)...
[POL_Wine_PrefixCreate] Message: Using wine 3.0.4
[POL_Wine_InstallVersion] Message: Installing wine version path: 3.0.4, x86
[POL_Wine_InstallVersion] Message: Wine site: https://phoenicis.playonlinux.com/index.php/wine?os=linux
env LD_LIBRARY_PATH="" wget --prefer-family=IPv4 -q https://phoenicis.playonlinux.com/index.php/wine?os=linux -O-
[POL_Wine_InstallVersion] Message: Winebuild data: {
  "version": "3.0.4",
  "url": "http://www.playonlinux.com/wine/binaries/phoenicis/upstream-linux-x86/PlayOnLinux-wine-3.0.4-upstream-linux-x86.tar.gz",
  "sha1sum": "7dace0daf0eed442bcd7368c3a4dd0f4b547320f",
  "geckoFile": null,
  "geckoUrl": null,
  "geckoMd5": null,
  "monoFile": null,
  "monoUrl": null,
  "monoMd5": null
}
[POL_Wine_InstallVersion] Message: Wine address found: http://www.playonlinux.com/wine/binaries/phoenicis/upstream-linux-x86/PlayOnLinux-wine-3.0.4-upstream-linux-x86.tar.gz
/usr/local/bin/perl: error while loading shared libraries: libssp.so.0: cannot open shared object file: No such file or directory
Server sha1 : 7dace0daf0eed442bcd7368c3a4dd0f4b547320f
Client sha1 :
[POL_Config_PrefixWrite] Message: Prefix config write: ARCH x86
[POL_Config_PrefixWrite] Message: Prefix config write: VERSION 3.0.4
[POL_Wine_SetVersionEnv] Message: Wine 3.0.4 not installed. Installing it
[POL_Wine_InstallVersion] Message: Installing wine version path: 3.0.4, x86
[POL_Wine_InstallVersion] Message: Wine site: https://phoenicis.playonlinux.com/index.php/wine?os=linux
env LD_LIBRARY_PATH="" wget --prefer-family=IPv4 -q https://phoenicis.playonlinux.com/index.php/wine?os=linux -O-
[POL_Wine_InstallVersion] Message: Winebuild data: {
  "version": "3.0.4",
  "url": "http://www.playonlinux.com/wine/binaries/phoenicis/upstream-linux-x86/PlayOnLinux-wine-3.0.4-upstream-linux-x86.tar.gz",
  "sha1sum": "7dace0daf0eed442bcd7368c3a4dd0f4b547320f",
  "geckoFile": null,
  "geckoUrl": null,
  "geckoMd5": null,
  "monoFile": null,
  "monoUrl": null,
  "monoMd5": null
}
[POL_Wine_InstallVersion] Message: Wine address found: http://www.playonlinux.com/wine/binaries/phoenicis/upstream-linux-x86/PlayOnLinux-wine-3.0.4-upstream-linux-x86.tar.gz
/usr/local/bin/perl: error while loading shared libraries: libssp.so.0: cannot open shared object file: No such file or directory
Server sha1 : 7dace0daf0eed442bcd7368c3a4dd0f4b547320f
Client sha1 :
[POL_Wine_SetVersionEnv] Message: Wine 3.0.4 not installed. Installing it
[POL_Wine_InstallVersion] Message: Installing wine version path: 3.0.4, x86
[POL_Wine_InstallVersion] Message: Wine site: https://phoenicis.playonlinux.com/index.php/wine?os=linux
[POL_Wine_InstallVersion] Message: Winebuild data: {
  "version": "3.0.4",
  "url": "http://www.playonlinux.com/wine/binaries/phoenicis/upstream-linux-x86/PlayOnLinux-wine-3.0.4-upstream-linux-x86.tar.gz",
  "sha1sum": "7dace0daf0eed442bcd7368c3a4dd0f4b547320f",
  "geckoFile": null,
  "geckoUrl": null,
  "geckoMd5": null,
  "monoFile": null,
  "monoUrl": null,
  "monoMd5": null
}
[POL_Wine_InstallVersion] Message: Wine address found: http://www.playonlinux.com/wine/binaries/phoenicis/upstream-linux-x86/PlayOnLinux-wine-3.0.4-upstream-linux-x86.tar.gz
Traceback (most recent call last):
  File "/usr/share/playonlinux/python/setupwindow/POL_SetupFrame.py", line 392, in DebugClick
    self.parent.BugReport(e)
AttributeError: 'NoneType' object has no attribute 'BugReport'
/usr/local/bin/perl: error while loading shared libraries: libssp.so.0: cannot open shared object file: No such file or directory
/usr/share/playonlinux/lib/playonlinux.lib: line 335:  4689 Killed                  bash "$@"
Unhandled exception in thread started by <bound method gui_server.handler of <gui_server(Thread-2, started<PHONE_NUMBER>76160)>>
Traceback (most recent call last):
  File "/usr/share/playonlinux/python/setupwindow/gui_server.py", line 53, in handler
    connection.send(self.result)
socket.error: [Errno 104] Connection reset by peer
Registered PID: 2962 (Missing)
Registered PID: 2996 (Missing)
Registered PID: 3099 (Missing)
Registered PID: 3185 (Missing)
Registered PID: 3291 (Missing)
Registered PID: 3372 (Missing)
Registered PID: 3462 (Missing)
Registered PID: 3548 (Missing)
Registered PID: 4526 (Present)
Registered PID: 4689 (Missing)
Registered PID: 4755 (Missing)
Registered PID: 4789 (Missing)

bash: ./conty_lite_lz4.sh: /usr/bin/env: bad interpreter: Text file busy

Probably some process(es) using it, if you have lsof installed you can list all processes using the script with this command:
sudo lsof /usr/local/conty_lite_lz4.sh

And regarding playonlinux, i see it uses perl binary from /usr/local/bin, even though builtin /usr/bin have a higher priority. What if you try to run like this?
SUDO_MOUNT=1 USE_SYS_UTILS=1 ./conty_lite_lz4.sh --tmpfs /usr/local playonlinux

or
SUDO_MOUNT=1 USE_SYS_UTILS=1 ./conty_lite_lz4.sh --setenv PATH "bin:/sbin" playonlinux

Also, does the internet connection work in other apps (in Steam or in Lutris, for example)?

$HOME is mounted on ChromeOS as noexec.
chronos@localhost /usr/local $ sudo lsof /usr/local/conty_lite_lz4.sh
chronos@localhost /usr/local $
chronos@localhost /usr/local $ SUDO_MOUNT=1 USE_SYS_UTILS=1 ./conty_lite_lz4.sh --tmpfs /usr/local playonlinux
bash: ./conty_lite_lz4.sh: /usr/bin/env: bad interpreter: Text file busy
chronos@localhost /usr/local $ SUDO_MOUNT=1 USE_SYS_UTILS=1 ./conty_lite_lz4.sh --setenv PATH "/bin:/sbin" playonlinux
bash: ./conty_lite_lz4.sh: /usr/bin/env: bad interpreter: Text file busy

Haven't tried a network connection in steam or lutris, which both error out.
in playonlinux, it looks like it is downloading, but then complains about a network error afterwards.

I do see these errors in dmesg:
[75616.982752] Chromium OS LSM: sb_mount Mounting a filesystem with 'exec' flag requires CAP_SYS_ADMIN in init ns obj="/run/chrome/gvfs" pid=32600 cmdline="/usr/local/libexec/gvfsd-fuse /run/chrome/gvfs -f"
[75616.982759] Chromium OS LSM: sb_mount dev=gvfsd-fuse type=fuse.gvfsd-fuse flags=0x6
[75616.987749] Chromium OS LSM: sb_mount Mounting a filesystem with 'exec' flag requires CAP_SYS_ADMIN in init ns obj="/run/chrome/gvfs" pid=32602 cmdline="fusermount3 -o rw,nosuid,nodev,subtype=gvfsd-fuse -- /run/chrome/gvfs"
[75616.987754] Chromium OS LSM: sb_mount dev=gvfsd-fuse type=fuse.gvfsd-fuse flags=0x6
[75616.989519] Chromium OS LSM: sb_mount Mounting a filesystem with 'exec' flag requires CAP_SYS_ADMIN in init ns obj="/run/chrome/gvfs" pid=32603 cmdline="fusermount3 -o rw,nosuid,nodev -- /run/chrome/gvfs"
[75616.989523] Chromium OS LSM: sb_mount dev=/dev/fuse type=fuse flags=0x6

Does it work after the system reboot or still gives "bad interpreter: Text file busy"?

Ok, i figured out the reason why this happens - this happens when the previously launched Conty wasn't unmounted. Perhaps you missed the moment when it asked to enter sudo password to unmount the image or it was roughly terminated.
mount | grep conty

I will fix this by mounting the image with read-only flag, so even if it's not unmounted you'll stil be able to run it.
For now you can either unmount the image manually or try to run it directly with bash to avoid this error:
SUDO_MOUNT=1 USE_SYS_UTILS=1 bash conty_lite_lz4.sh ls

Regarding internet connection, I guess the easiest way to check if it works is with ping or with wget (if ping doesn't work):
./conty.sh ping <IP_ADDRESS>
./conty.sh ping google.com
./conty.sh wget "https://www.google.com/"

/etc/resolv.conf and /etc/hosts get automatically binded to the container, so the connection should work, but maybe there are some other files need to be binded, i'm not familiar with ChromeOS file structure. You can try to bind whole /etc to the container (with BIND="/etc" env variable) and see if this helps.
And i still suggest to try to launch PoL in one of these ways and see if it changes anything:
SUDO_MOUNT=1 USE_SYS_UTILS=1 ./conty_lite_lz4.sh --tmpfs /usr/local playonlinux
SUDO_MOUNT=1 USE_SYS_UTILS=1 ./conty_lite_lz4.sh --setenv PATH "/bin:/sbin" playonlinux

Yup. Definitely looks like it never unmounted properly.
chronos@localhost /usr/local $ SUDO_MOUNT=1 USE_SYS_UTILS=1 bash conty_lite_lz4.sh ls
Using system squashfuse and bwrap
Using regular mount command (sudo mount) instead of squashfuse
mount: /tmp/conty_lite_lz4.sh_chronos_26947/mnt: /dev/loop8 already mounted or mount point busy.
Mounting the squashfs image failed!
chronos@localhost /usr/local $
chronos@localhost /usr/local $ sudo losetup --list
NAME        SIZELIMIT  OFFSET AUTOCLEAR RO BACK-FILE                                                    DIO LOG-SEC
/dev/loop0          0       0         0  0 /mnt/stateful_partition/encrypted.block                        1     512
/dev/loop1          0       0         0  1 /usr/share/chromeos-config/configfs.img                        0     512
/dev/loop2          0       0         1  1 /opt/google/containers/android/system.raw.img                  0     512
/dev/loop3          0       0         1  1 /opt/google/containers/arc-sdcard/rootfs.squashfs              0     512
/dev/loop4          0       0         1  1 /opt/google/containers/arc-obb-mounter/rootfs.squashfs         0     512
/dev/loop5          0       0         1  1 /usr/share/chromeos-assets/speech_synthesis/patts.squash       0     512
/dev/loop6          0       0         1  1 /usr/share/chromeos-assets/quickoffice/quickoffice.squash      0     512
/dev/loop7          0       0         0  1 /cros-components/cros-termina/13807.0.0/image.ext4             0     512
/dev/loop8          0 1272792         1  0 /usr/local/conty_lite_lz4.sh                                   0     512
/dev/loop10         0       0         0  1 /cros-components/lacros-dogfood-dev/91.0.4450.0/image.squash   0     512

Either sudo dmsetup remove /dev/loop8 or sudo losetup -d /dev/loop8 got rid of that for me.
Re: network issues I see this:
chronos@localhost /usr/local $ SUDO_MOUNT=1 USE_SYS_UTILS=1 ./conty_lite_lz4.sh ping <IP_ADDRESS>
Using system squashfuse and bwrap
Using regular mount command (sudo mount) instead of squashfuse
Running Conty

ping: socket: Operation not permitted
chronos@localhost /usr/local $ SUDO_MOUNT=1 USE_SYS_UTILS=1 ./conty_lite_lz4.sh ping <IP_ADDRESS>
Using system squashfuse and bwrap
Using regular mount command (sudo mount) instead of squashfuse
Running Conty

ping: socket: Operation not permitted

We had to put a wrapper on ping to make that work for us:
#!/bin/bash
sudo -E /usr/local/sbin/capsh --caps="cap_net_raw+eip cap_setpcap,cap_setuid,cap_setgid+ep" \
    --keep=1 --user=nobody --addamb=cap_net_raw -- \
    -c "/usr/local/bin/ping.elf $@"

SUDO_MOUNT=1 USE_SYS_UTILS=1 ./conty_lite_lz4.sh ssh host works fine though.
Re: Playonlinux I see this:

Then...

Looks like an install starts right:

Here are some errors with installing the msttfcorefonts:

Let's still try installing:

Looks like it gets stuck there.

(Maybe a force unmount might be an option if there's an error with mounting? Or just using the existing loopback device if it exists?

Maybe remapping home dir away from a noexec mount if it is detected as such might also be useful.

You can try to set custom HOME directory like this:
SANDBOX=1 HOME_DIR="/usr/local/some_custom_dir" SUDO_MOUNT=1 USE_SYS_UTILS=1 ./conty_lite_lz4.sh playonlinux

Or
SUDO_MOUNT=1 USE_SYS_UTILS=1 ./conty_lite_lz4.sh --bind /usr/local/some_custom_dir $HOME playonlinux

(Maybe a force unmount might be an option if there's an error with mounting? Or just using the existing loopback device if it exists?

As for unmounting when SUDO_MOUNT is enabled, i will try to find a solution.

I added a fix for unmount issue, the script will use the same mountpoint now if possible. Could you please try the new script? You can easily recreate the existing Conty and add a new squashfs-start.sh script like this:
Frist copy the squashfs image from the conty_lite_lz4.sh file (no need to rebuild it, just copy with dd):
dd if=/usr/local/conty_lite_lz4.sh of=/usr/local/image.squashfs bs=1272792 skip=1

Where bs=1272792 is the offset (can be viewed with ./conty_lite_lz4.sh -o)
After that download utils.tar and new squashfs-start.sh directly from this repo:
cd /usr/local
wget https://raw.githubusercontent.com/Kron4ek/Conty/master/squashfs-start.sh
wget https://github.com/Kron4ek/Conty/raw/master/utils.tar

Then just combine all these with cat:
cat squashfs-start.sh utils.tar image.squashfs > conty_lite_lz4_new.sh
chmod +x conty_lite_lz4_new.sh

Done!

The squashfs-start.sh script appears to work.
changing $HOME does not though...
chronos@localhost /usr/local $ mkdir home
chronos@localhost /usr/local $ SUDO_MOUNT=1 USE_SYS_UTILS=1 ./conty_lite_lz4.sh --bind /usr/local/home $HOME playonlinux
Using system squashfuse and bwrap
Using regular mount command (sudo mount) instead of squashfuse
Running Conty

Looking for python... 3.9.2 - skipped
Looking for python2.7... 2.7.18 - wxversion(s): 3.0-gtk3
/usr/lib64/python2.7/site-packages/wx-3.0-gtk3/wx/_core.py:16629: UserWarning: wxPython/wxWidgets release number mismatch
  warnings.warn("wxPython/wxWidgets release number mismatch")
selected
/usr/lib64/python2.7/site-packages/wx-3.0-gtk3/wx/_core.py:16629: UserWarning: wxPython/wxWidgets release number mismatch
  warnings.warn("wxPython/wxWidgets release number mismatch")
/bin/sh: line 1: xrdb: command not found
1
[main] Message: PlayOnLinux (4.3.4) is starting
[clean_tmp] Message: Cleaning temp directory
[POL_Config_Write] Message: Config write: VDRIVES_LINK_MADE TRUE
[Check_OpenGL] Warning: check_dd_x86 missing, test skipped
[Check_OpenGL] Warning: check_dd_amd64 missing, test skipped
[POL_System_CheckFS] Message: Checking filesystem for /home/chronos/user/.PlayOnLinux/
[FS_Check] Warning: The following file is located on a noexec mounted filesystem.
It might prevent wine from working

/home/chronos/user/.PlayOnLinux/

(/home/chronos/user is $HOME by default for ChromeOS.)

Ok, this will probably work then:
SUDO_MOUNT=1 USE_SYS_UTILS=1 ./conty_lite_lz4.sh --bind /usr/local/home $HOME --setenv HOME /usr/local/home playonlinux

From within the container it will still be /home/chronos/user, but it will actually be /usr/local/home. Check if new files/dirs appers in it:
ls -a /usr/local/home

$ ls -a /usr/local/home
 .   ..   .fontconfig   .PlayOnLinux  "PlayOnLinux's virtual drives"

Does PlayOnLinux works fine with HOME on /usr/local/home or still gets stuck at some point?

(Currently working on just trying to get the larger squashfs image to work in https://github.com/Kron4ek/Conty/issues/14 )


offset substitution problem

Hi @enty8080 Do you have any plans for using encoders? When I do encoding on a shellcode, I ran into BadChars problem \x00 messing with the compiler and if I try to remove badChars manually I will mess up offset substitutions.
Cheers Bro!

Hi @enty8080 I appreciate your response.
I was trying to use hatsploit/payloads/windows/x64/shell_reverse_tcp.py and I want to get rid of \x00 inside the shellcode.
Cheers Bro!

@miralayipouya I think it is not possible to write a completely null-free shellcode for Windows, but we'll try later.


Differentiate between job failures and cancellations

At present, there is no distinction between job failures and cancellations. Therefore, we should seek a way to differentiate between these two statuses.
https://github.com/kbase/collections/blob/b07c7e04ae4a7ac4f0c1f99d60175f60fd909d6d/src/loaders/jobs/taskfarmer/taskfarmer_task_mgr.py#LL120C11-L120C11

Slack discussion summary:

If a job is cancelled it usually makes sense to resubmit it, but failures may mean the job can't proceed without changes
May be able to detect by catching all exceptions at the top level of the tool calculation script and logging a key word, which will end up in the slurm logs


Help: Custom notes

Describe your problem here.
So i am making custom notes and the sprites and splashes won't show up. Here's the code, i don't know what went wrong:
function onCreate()
	--Iterate over all notes
	for i = 0, getProperty('unspawnNotes.length')-1 do
		--Check if the note is an Knife Note
		if getPropertyFromGroup('unspawnNotes', i, 'noteType') == 'Knife Note' then
			setPropertyFromGroup('unspawnNotes', i, 'texture', 'mods/images/Knife'); --Change texture
			setPropertyFromGroup('unspawnNotes', i, 'noteSplashTexture', 'mods/images/BloodSplash');	--Splash animation texture
			setPropertyFromGroup('unspawnNotes', i, 'hitHealth', '0.050'); --Default value is: 0.023, health gained on hit
			setPropertyFromGroup('unspawnNotes', i, 'missHealth', '0.0475'); --Default value is: 0.0475, health lost on miss
			setPropertyFromGroup('unspawnNotes', i, 'hitCausesMiss', true);

			if getPropertyFromGroup('unspawnNotes', i, 'mustPress') then --Doesn't let Dad/Opponent notes get ignored
				setPropertyFromGroup('unspawnNotes', i, 'ignoreNote', true); --Miss has no penalties
			end
		end
	end
	--debugPrint('Script started!')
end

-- Function called when you hit a note (after note hit calculations)
-- id: The note member id, you can get whatever variable you want from this note, example: "getPropertyFromGroup('notes', id, 'strumTime')"
-- noteData: 0 = Left, 1 = Down, 2 = Up, 3 = Right
-- noteType: The note type string/tag
-- isSustainNote: If it's a hold note, can be either true or false
function goodNoteHit(id, noteData, noteType, isSustainNote)
	if noteType == 'Knife Note' then
		-- put something here if you want
	end
end

-- Called after the note miss calculations
-- Player missed a note by letting it go offscreen
function noteMiss(id, noteData, noteType, isSustainNote)
	if noteType == 'Knife Note' then
		-- put something here if you want
	end
end

Are you modding a build from source or with Lua?
Lua
What is your build target?
Windows x64
Did you edit anything in this build? If so, mention or summarize your changes.
Mods folder

Remove mods/images/ from the texture path

Nevermind, made a new texture and it worked

thank you for this tho


Incorrect Flexbox Positioning Causing Gaps

Summary
Basically the layout engine is incorrectly positioning columns and rows of elements in some very niche cases. The "margin" by which it is off is 100ths of a dp unit, which causes the tiniest of gaps to appear between columns and rows. I encountered this issue when using a simple formula to calculate a ratio that would adjust the fontSize, padding, and borderWidth of some Views(i.e. cells) in a Grid-like layout based on the screen size. I was testing this on 4 device emulators: a 4 WVGA(Nexus S), Nexus 6, Nexus 7(2012), and Nexus 9. And my physical Moto G 1st gen.  I chose the 4 aforementioned device emulators since there width in dp units is spread between(or after) the following breakpoints: 240, 400, 560, 720. I would attempt to pick a ratio, but it always seemed to work on all but one of the emulators(or the physical device). I tried this over and over until I found that 0.01 ratio per 3.2 dp units happens to work if I don't Math.floor the computed values for the fontSize, padding, and borderWidth. However if I tried more devices I'm sure this would break as well.
Required Details

Live example: https://rnplay.org/apps/E9S6xQ

let ratio = (smallestDimension / 2.9) * 0.01;//change the divisor to 3.2 if you want to see the positioning fixed.

Screenshot of incorrect positioning for both a column and a row:

Versions of React Native that this bug has been tested to occur on: 0.20.0, 0.21.0, 0.24.1, 0.25.1, 26.0
This bug occurs on both Android and IOS. I was only able to test IOS on rnplay.org and there are additional weird artifacts that show up that I can't even describe.
I am developing on a Windows machine.

Hmm, I can't repro on that live example or on a modern RN. I know Emil has made a bunch of css layout bugfixes since this was reported, so it's quite possible it's fixed, but it's also possible that it's dependent on some part of the guts that just make it flaky. I totally believe there are still bugs in this, and I would like to track them down, but I dunno if this report has any path to finding them at this point. I am going to close this issue, but if you can still find these off-by-a-pixel bugs in the layout with current RN then I would love to see a new issue - especially if it repro's on rnplay.org .

Expo's Snack might be a better way to go nowadays - that looks a lot hotter than the old RN playground.

@lacker Woah. That is really recent. I'll try to use that instead if that service is preferred. Thanks for the recommendation!

@lacker Here's my new issue with all the pertinent details https://github.com/facebook/react-native/issues/13305


Fix link with no scheme

The link was rendered to point to a file in the repo, not the remote link intended.

Oh, cool - thanks!


Enable AllowTopicCreation config in example

fix #74

@husio Not sure why the check failed, do you know the reason?

@supereagle I am no longer contributing to this repository.
From what I can see, tests are failing for tip version of the compiler. This should not be a blocker.

It looks like they've changed compress/gzip library in go 1.8.   I'll take a look.

Yep. They've fixed DataModification field in the header of gzipped data.   It wasn't a good idea to hard code binary results in our test, I guess. :)

@e-max  Could you help to fix the error in tests? Thanks.

Yes, sure. I am on it.

Master is fixed. Could you please rebase your branch on it?

Thanks!


Incorrect metadata in the middle of processing chain

Just started using this library. Works great.
However I am facing a small problem (which could totally be my misunderstanding)
`
fs.readdir(process.argv[2], function(err, files) {
if(err) return;
for(var f in files) {
    (function(filename) {
        fs.stat(path.join(process.argv[2], filename), function(err, stat) {
            if(err) {
                console.log(err);
                return;
            }

            if(stat.isFile()) {
                var i = sharp(path.join(process.argv[2], filename));

                //a loop here for different target heights - omitting that for now
                i.clone()
                .resize(null, targetHeight[0])
                .rotate(90)
                .metadata()
                .then(function(metadata) {
                    //the metadata obtained here is that of the original image i
                    //and not of the resized/rotated image
                    return i.resize(metadata.width-20, metadata.height-20)
                            .crop(sharp.gravity.center)
                            .toFile(path.join(__dirname, process.argv[3], targetHeight[0]+"_"+filename))
                })

            }
        })

    })(files[f]);
}

})
`
I have a processing chain where I resize the image down to a max height, rotate it and the shave off 10px from all the edges. I might be doing it the wrong way, but just wanted to know, that if I access metadata after a couple of operations, is it the expected behavior to obtain the metadata of the original image and not of the half-way modified image.

Ok. Now that I read the module's code, rotate() and resize(), just update the options object of the current instance instead of actually performing the operation. Is this understanding correct?

How would it be performance-wise to perform the operation side by side with the options update?
Any alternate way of what I am looking to achieve - shaving off 10px from all edges of a rotated/resized image?

Hi Rahul, your understanding is correct. From your example it looks like the first resize operation is there to calculate the output width for a given height, in which case I think #236 should provide most of what you're looking for.

I actually had tried achieving the same thing in python and node, and it worked much faster in python, the metadata change reflected right because python is not 'chaining' the transformation requests may be and executing them as we go. I am more comfortable with nodejs and was thus wondering if I am using the library incorrectly that is leading to longer time in the same task, and higher CPU utilisation. Even the final sizes (in KBs) of the images generated using node and python are different.
I have created a repo  with both python and nodejs codes. If you get time, it would be great to just run through the codes (very small ones) and let me know if I am using it incorrectly. Also, would using read/write streams help improving performance?
I would go through the code in the meanwhile to figure out more.

I have also added the timings for the two languages. Python takes more real time but lesser CPU time and user time, which as per my understanding means node uses all the CPU cores a lot more than python. Correct me if I am wrong. My CPU utilisation peaked at about 380% when using node and 270% for python.

Please can you try adding a sharp.simd(true); approximately here to see what effect it has on CPU time. IIRC the Python bindings do the equivalent by default.

Time without simd
real	1m8.676s
user	3m59.421s
sys	0m8.072s
Time with simd
real	1m1.621s
user	3m32.472s
sys	0m7.822s

Thanks for the updated figures, it looks like the Node version is ~25% faster (83s vs 61s). Are you worried about the CPU utilisation? I'd say higher is better.
If you've not seen it, sharp.concurrency() might be worth experimenting with to see if you can squeeze out a few more seconds.

Thanks for the suggestion. Will give it a look.
Researched a bit more and found out that libvips (atleast from the command line) needs to create intermediate images for successive operations. The .v format is faster than other intermediate formats, but with Disk IO involved multiple times, it is bound to be slow. Python and C however can overcome this intermediate storage and are hence faster than the command line (The chaining operations section here http://www.vips.ecs.soton.ac.uk/supported/current/doc/html/libvips/using-cli.html).
Wanted to confirm if sharp too can/does avoid intermediate storage? Would using read/write streams and sharp as a pipeline be more performant than constructing a sharp instance from local file.

sharp only uses intermediate storage of compressed data chunks when using Streams. File-based I/O is handled by libvips directly and is usually faster - see http://sharp.dimens.io/en/stable/performance/#results

@rnanwani I'd change your Python a little. Instead of similarity and affine, I'd use:
            imageScale = h/im.height
            im = im.resize(imageScale)
            im = im.rot90()
            # The height and width obtained after the previous two operations

.resize() is much, much higher quality than .similarity(), and .rot90() is much faster than .affine(). They mostly cancel out, so on this laptop I see 51s before this change and 53s after.

@rnanwani Is there anything else you need help with here?

No, this was more of a question. Just in case someone else stumbles upon similar questions, I got some good response from the contributors in libvips repo as well.
https://github.com/jcupitt/libvips/issues/457
Also on stack overflow
http://stackoverflow.com/questions/37382402/comparing-two-different-processes-based-on-the-real-user-and-sys-times/37485102#37485102


Feature Request: Support for Streaming Responses from OpenAI API

Being able to receive the output as a stream would be very helpful. Streaming would allow us to handle each chunk of data as it arrives, rather than waiting for the entire data set to be processed and sent back. This is particularly useful for dealing with GPT4 which has a rather long wait time to get a full completion answer without streaming.
Suggested format
@declarai.task(streaming=True)
def generate_large_text(title: str) -> AsyncIterator[str]:
    """
    Generate a large text based on the provided title, received in chunks.
    """

for chunk in generate_large_text(title="Some long text"):
    process_chunk(chunk)

Hey! thanks for raising that @tranhoangnguyen03
I thought about the following:

Basically every chunk is the response of the given chunk .
What do you think about it ? Would that be convenient ?

Looks really neat!

Merged. will be integrated in v0.1.9 later on this week.

@tranhoangnguyen03 Hey, we integrated steaming both to tasks and chats in v0.10.0. Please let me know if there anything else needed!
Thanks for your involvement and active part in declarai's journey!
Docs - https://declarai.com/features/streaming/


[Bug] 窗口函数last_value窗口不生效

Search before asking

[X] I had searched in the issues and found no similar issues.

Version
doris-1.2.2
What's Wrong?
表数据如下

执行sql为
select
u_id,
u_city,
u_salary,
last_value(u_salary) over (partition by u_city order by u_id rows between unbounded preceding and 1 preceding) last_value_test
from example_window_tb;

此SQL使用SPARK的返回结果为

以上是我期望的结果，根据u_city 分区，在两个分区内分别计算last_value。

而在Doris中的返回结果为：

partition by u_city 没有生效，sz分区的第一行不是null，而是gz分区的最后一行。
What You Expected?

How to Reproduce?
No response
Anything Else?
No response
Are you willing to submit PR?

[ ] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

https://github.com/apache/doris/pull/17084


Minor wallet updates

Fix https://github.com/mintlayer/mintlayer-core/issues/947

Besides the file lock problem, I don't have a problem with this PR. We should find a better place for it.


[Errno 2] No such file or directory: '/data/options.json' in standalone mode

Hello,
i'm trying to run it on standalone mode. As per instruction i have created the options.json in the same folder but when i lauch python3 main.py i get this error:
deunan@victron-lab:~/batmon-ha$ python3 main.py
error reading /data/options.json, trying options.json [Errno 2] No such file or directory: '/data/options.json'
Traceback (most recent call last):
File "/home/deunan/batmon-ha/bmslib/store.py", line 51, in load_user_config
with open('/data/options.json') as f:
FileNotFoundError: [Errno 2] No such file or directory: '/data/options.json'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/home/deunan/batmon-ha/main.py", line 28, in
user_config = load_user_config()
File "/home/deunan/batmon-ha/bmslib/store.py", line 57, in load_user_config
conf = dotdict(json.load(f))
File "/usr/lib/python3.10/json/init.py", line 293, in load
return loads(fp.read(),
File "/usr/lib/python3.10/json/init.py", line 346, in loads
return _default_decoder.decode(s)
File "/usr/lib/python3.10/json/decoder.py", line 337, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/usr/lib/python3.10/json/decoder.py", line 353, in raw_decode
obj, end = self.scan_once(s, idx)
json.decoder.JSONDecodeError: Expecting ',' delimiter: line 17 column 3 (char 349)
deunan@victron-lab:~/batmon-ha$
I have also created a subfolder named data and copied the same same inside it, but the error don't change.
What i'm doing wrong?

To me happens it too (missing /data/options.json), but it continues and than works.
Are you sure your options.json is valid? Try jq tool to validate yours options.json

yep, looks like your json is not valid

Found the error. Since i copied and modified the example options.json, there is an error in the example.
"invert_current": false misses a comma at the end.
Now works very well, thank you for pointing me in the right direction


Update figure names to include qubit indices

Summary
This PR updates figure names so that the physical qubit indices (up to 5) are included and changes the experiment type prefix to always be the experiment class (composite experiments with flatten_results on had the composite experiment class name before). The experiment type has also been added to the figure metadata class.
Details and comments
For a non-composite experiment on qubit 0, its previous figure name StandardRB_Fig-0_Exp-83ca04ad.svg would now be StandardRB_Fig-0_Q0_Exp-83ca04ad.svg.
For a child RB experiment on qubits 0-7 inside a ParallelExperiment with flatten_results=True, its previous figure name BatchExperiment_Fig-1_Exp-2b7f0a55.svg would now be StandardRB_Fig-1_Q0_Q1_Q2_Q3_Q4_Exp-2b7f0a55.svg.

In my opinion it's fine to completely omit Fig, Exp, and index. So StandardRB_Fig-0_Q3_Q1_Exp-0260886a.svg becomes StandardRB-Q3_Q1-0260886a.svg.

The name has been updated to omit Fig and Exp as suggested, with a numerical suffix added when there is a name conflict. The examples in the PR description have been updated.


Error when trying to render

When I try to render a Resizable component, I always throw this error.
invariant.js:39 Uncaught Invariant Violation: Element type is invalid: expected a string (for built-in components) or a class/function (for composite components) but got: object. Check the render method of DraggableElementsContainer.
How can I fix this?

@brianluong Hi.thanks.Can you show me a minimum of code to reproduce?

I have a very basic application. Only one component and a render method.
I've tried

and also different values for props to pass in, but it's still giving me that error.
Am I missing something?

@brianluong I do not know If you do not look at the code. what is your npm version.

My NPM version is 3.3.12.
Thank you for your help. I'm new to this.

Ummmmmm, it works on my env(npm2 and npm3)
import React, { Component } from 'react';
import Box from 'react-resizable-box';

export default class Example extends Component {
  render() {
    return (
      <Box customStyle={{ background: '#333', pasdding: '10px' }}>
        test
      </Box>
    );
  }
}

import React from 'react';
import { render } from 'react-dom';
import Example from './example';

render(<Example />, document.querySelector('#root'));

`var React = require('react');
var ReactDOM = require('react-dom');
var ReactDnD = require('react-dnd');
var Resizable = require('react-resizable-box');
var MainApplication =  React.createClass({
render : function() {
	return (

			<Resizable></Resizable>

	);
}

});
ReactDOM.render(, document.getElementById('main'));`

@brianluong Uhhhh... please use bellow
var Resizable = require('react-resizable-box').default;

@brianluong Uhhhh... please use bellow

var Resizable = require('react-resizable-box').default;

I have done this and I am still getting the error.

Any other ideas?

it works on my env.
var React = require('react');
var ReactDOM = require('react-dom');
var ReactDnD = require('react-dnd');
var Resizable = require('react-resizable-box').default;

var MainApplication =  React.createClass({

  render : function() {
    return (

        <Resizable></Resizable>

    );
  }
});

ReactDOM.render(<MainApplication/>, document.getElementById('root'));

Or use import instead of require

Message when I installed the module. Could the error come from conflicts with installed node modules?

OK it actually works if I add .default.
Can you explain why this is the case?
Thanks!

Babel6 transpile export defalut class Resizable extends Component {}  to exports.default = Risizable;


chore(deps): upgrade dependencies

Upgrades project dependencies. See details in workflow run.

Automatically created by projen via the "upgrade-1.x" workflow

⚪ Backport skipped
The pull request was not backported as there were no branches to backport to. If this is a mistake, please apply the desired version labels or run the backport tool manually.
Manual backport
To create the backport manually run:
backport --pr 1143

Questions ?
Please refer to the Backport tool documentation


"Unexpected field" error when uploading video/audio

Hi. Does this still work [https://github.com/affanshahid/multer-storage-cloudinary/issues/4] ?
I get the error "Unexpected field" every time I try to upload a file that its not a image (mp3, mp4 etc).
I changed resource_type:  to raw, video and auto but it doesnt work. It only works if I upload an image.
Edit: I found the solution. You have to add ore more param:
https://stackoverflow.com/questions/70672530/upload-audio-and-image-from-the-same-form-using-multer-storage-cloudinary/70685793#70685793

You have to add ore more param:
https://stackoverflow.com/questions/70672530/upload-audio-and-image-from-the-same-form-using-multer-storage-cloudinary/70685793#70685793


Cursor blinks while moving using keyboard

Steps to Reproduce

Run flutter create test.
Create a TextField with long, multiple lines as in the snippet
Run, paste multiple lines of text and move the cursor around using long keyboard presses

Expected results: Cursor doesn't blink while it moves
Actual results: Cursor blinks while it moves

Code
import 'package:flutter/material.dart';

void main() {
  runApp(MyApp());
}

class MyApp extends StatelessWidget {
  @override
  Widget build(BuildContext context) {
    return MaterialApp(
      title: 'Flutter Demo',
      theme: ThemeData(
        primarySwatch: Colors.blue,
      ),
      home: MyHomePage(title: 'Flutter Demo Home Page'),
    );
  }
}

class MyHomePage extends StatefulWidget {
  MyHomePage({Key key, this.title}) : super(key: key);

  final String title;

  @override
  _MyHomePageState createState() => _MyHomePageState();
}

class _MyHomePageState extends State<MyHomePage> {
  final _controller = TextEditingController();

  @override
  Widget build(BuildContext context) {
    return Scaffold(
      appBar: AppBar(
        title: Text(widget.title),
      ),
      body: Center(
        child: Container(
          constraints: BoxConstraints(maxHeight: 400),
          child: TextField(
            controller: _controller,
            keyboardType: TextInputType.multiline,
            maxLines: null,
            decoration: InputDecoration(
              labelText: 'Test',
              hintText: 'Enter some text'
            )
          ),
        )
      ),
    );
  }
}

Logs
% flutter doctor -v
[✓] Flutter (Channel master, 1.24.0-4.0.pre.144, on Mac OS X 10.15.7 19H2 darwin-x64, locale en-GB)
    • Flutter version 1.24.0-4.0.pre.144 at /Library/Frameworks/flutter
    • Framework revision 470346f775 (2 hours ago), 2020-10-29 09:56:28 -0700
    • Engine revision 073263e39d
    • Dart version 2.11.0 (build 2.11.0-260.0.dev)

[✓] Android toolchain - develop for Android devices (Android SDK version 29.0.3)
    • Android SDK at /Users/tgucio/Library/Android/sdk
    • Platform android-29, build-tools 29.0.3
    • Java binary at: /Applications/Android Studio.app/Contents/jre/jdk/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 1.8.0_242-release-1644-b3-6222593)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 11.4.1)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Xcode 11.4.1, Build version 11E503a
    • CocoaPods version 1.9.1

[✓] Android Studio (version 4.0)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin version 46.0.2
    • Dart plugin version 193.7361
    • Java version OpenJDK Runtime Environment (build 1.8.0_242-release-1644-b3-6222593)

[✓] VS Code (version 1.50.1)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.15.1

[✓] Connected device (1 available)
    • macOS (desktop) • macos • darwin-x64 • Mac OS X 10.15.7 19H2 darwin-x64

• No issues found!

flutter doctor -v
[✓] Flutter (Channel master, 1.24.0-4.0.pre.82, on Mac OS X 10.15.4 19E2269 darwin-x64,
    locale en-IN)
    • Flutter version 1.24.0-4.0.pre.82 at /Users/dhs/documents/Fluttersdk/flutter
    • Framework revision e5814756a2 (3 days ago), 2020-10-27 01:47:03 -0700
    • Engine revision<PHONE_NUMBER>
    • Dart version 2.11.0 (build 2.11.0-260.0.dev)

[✓] Android toolchain - develop for Android devices (Android SDK version 30.0.0)
    • Android SDK at /Users/dhs/Library/Android/sdk
    • Platform android-30, build-tools 30.0.0
    • Java binary at: /Applications/Android
      Studio.app/Contents/jre/jdk/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 1.8.0_242-release-1644-b3-6222593)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 12.0.1)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Xcode 12.0.1, Build version 12A7300
    • CocoaPods version 1.9.3

[✓] Chrome - develop for the web
    • Chrome at /Applications/Google Chrome.app/Contents/MacOS/Google Chrome

[✓] Android Studio (version 4.0)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin version 46.0.2
    • Dart plugin version 193.7361
    • Java version OpenJDK Runtime Environment (build 1.8.0_242-release-1644-b3-6222593)

[✓] VS Code (version 1.50.1)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.15.1

[✓] Connected device (4 available)
    • iPhone SE (2nd generation) (mobile) • 6C85835D-FBFD-4AB3-8DE8-B4FAD35E5367 • ios
      • com.apple.CoreSimulator.SimRuntime.iOS-14-0 (simulator)
    • macOS (desktop)                     • macos                                •
      darwin-x64     • Mac OS X 10.15.4 19E2269 darwin-x64
    • Web Server (web)                    • web-server                           •
      web-javascript • Flutter Tools
    • Chrome (web)                        • chrome                               •
      web-javascript • Google Chrome 86.0.4240.111

• No issues found!

69321.mov.zip

Note that this isn't specific to MacOS - happens on Windows too (and I'd imagine on Linux as well).

Don't have Windows setup to verify this, but removing mac specific label and updating title.

Closing with https://github.com/flutter/flutter/pull/70787


Funnel to have smooth edges even if numbers are not evenly spread

At the moment the funnel dows not look much like a funnel when numbers are not very even

Is there a way that the funnel is made smoother, and looking like a funnel, even with vastly different numbers

The design of go-charts is referred to echarts, you can have a try on the website:https://echarts.apache.org/examples/en/editor.html?c=funnel,  by adjusting the config to get the preview. If you are satisfied the preview, please provide the config to me.

Thank you for the suggestion @vicanso
Played with it a for a bit, and it does not seem to support it outright.
So to make it work as expected had to basically hardcode the values, regardless of the real values to get the visual effect.
But instead of hardcoding it, I manually deduced it from the number of labels.
Examples:
painter, errChart := charts.FunnelRender(
  lo.Reverse(lo.RangeFrom(1.0, len(labels))),
  charts.TitleTextOptionFunc("Funnel"),
  charts.LegendLabelsOptionFunc(labels), func(opt *charts.ChartOption) {
	  for index := range opt.SeriesList {
		  opt.SeriesList[index].Label.Formatter = "{b}"
	  }
  },
  charts.ThemeOptionFunc(charts.ThemeAnt),
)

Output:


Change seekbar progress from code with animation

Enhancement:
I guess it would look much better if you can change the value of the seekbar with animation (just a smooth movement of the thumb rather than abrupt movement) when changed programatically.

@warkiz Any insights on this? I hope you got my point.

@srujanb nice suggestion. I will try this once feel free.


Auto Label Bot

Is your feature request related to a problem? Please describe.
Add GitHub action to auto label issues with gssoc21 label when contributor asks to work under gssoc21. As it takes time for the maintainer to add labels, I can add a script that can auto-label issues with the gssoc21 label whenever contributors ask to work under that label.
Describe the solution you'd like
A script in .github folder to automate the process.
Describe alternatives you've considered
None
Additional context
Please assign me this issue with a GSSOC tag and a level tag.

GitHub action are not allowed.


The URLs of data for pretrained models not pointing to https

The location of the data changed, however the URL haven't been updated in the repository.
E.g.:

/pretrainedmodels/models/resnext.py

pretrained_settings = {
    'resnext101_32x4d': {
        'imagenet': {
            'url': 'http://data.lip6.fr/cadene/pretrainedmodels/resnext101_32x4d-29e315fa.pth',
            'input_space': 'RGB',
            'input_size': [3, 224, 224],
            'input_range': [0, 1],
            'mean': [0.485, 0.456, 0.406],
            'std': [0.229, 0.224, 0.225],
            'num_classes': 1000
        }
    },
    'resnext101_64x4d': {
        'imagenet': {
            'url': 'http://data.lip6.fr/cadene/pretrainedmodels/resnext101_64x4d-e77a0586.pth',
            'input_space': 'RGB',
            'input_size': [3, 224, 224],
            'input_range': [0, 1],
            'mean': [0.485, 0.456, 0.406],
            'std': [0.229, 0.224, 0.225],
            'num_classes': 1000
        }
    }
}

The URLs should point to https

They are actually not a secure (HTTPS) website. If you try for example, to copy in the URL to you browser and manually add the "s", it will (probably) work, but will actually redirect you to the HTTP URL. My work-around is to manually download the model through a browser, then move it to the .cache/torch/hub/checkpoints. This is the default download location that will be populated with models as they are downloaded. If the model is there, regardless of how it arrived, the attempt to access an insecure HTTP URL is skipped.


[bug] Bug in Gradient flow with backward(retain_graph=True) and split()

See below code for a minimally reproducible example. (original code in edits shows even worse gradients mangling but is bigger)
I get wrong gradient calculation, it is also stochastically returning different values. On GPU.
On CPU I get a core dumped:
Bus error (core dumped)

import mxnet as mx
from mxnet import gluon, autograd, nd

for i in range(4):
    ctx = mx.gpu()
    data = mx.nd.ones((1,10,), ctx=ctx)
    param = mx.nd.ones((1,10,), ctx=ctx)
    data.attach_grad(grad_req='write')
    param.attach_grad(grad_req='write')
    with autograd.record():
        z = data*param
        z1, z2 = z.split(2)
    z1.backward(retain_graph=True)
    print(data.grad.asnumpy())
    z2.backward()
    print(data.grad.asnumpy())
    print()

[[1. 1. 1. 1. 1. 0. 0. 0. 0. 0.]]
[[1. 1. 1. 1. 1. 0. 0. 0. 0. 0.]]

[[1. 1. 1. 1. 1. 0. 0. 0. 0. 0.]]
[[1. 1. 1. 1. 1. 1. 1. 1. 1. 1.]]

[[1. 1. 1. 1. 1. 0. 0. 0. 0. 0.]]
[[1. 1. 1. 1. 1. 0. 0. 0. 0. 0.]]

[[1. 1. 1. 1. 1. 0. 0. 0. 0. 0.]]
[[1. 1. 1. 1. 1. 1. 1. 1. 1. 1.]]

Correct output using indexing rather than splitting:
import mxnet as mx
from mxnet import gluon, autograd, nd

for i in range(4):
    ctx = mx.gpu()
    data = mx.nd.ones((1,10,), ctx=ctx)
    param = mx.nd.ones((1,10,), ctx=ctx)
    data.attach_grad(grad_req='write')
    param.attach_grad(grad_req='write')
    with autograd.record():
        z = data*param
        z1, z2 = z[:,:5], z[:,5:]
    z1.backward(retain_graph=True)
    print(data.grad.asnumpy())
    z2.backward()
    print(data.grad.asnumpy())
    print()

[[1. 1. 1. 1. 1. 0. 0. 0. 0. 0.]]
[[0. 0. 0. 0. 0. 1. 1. 1. 1. 1.]]

[[1. 1. 1. 1. 1. 0. 0. 0. 0. 0.]]
[[0. 0. 0. 0. 0. 1. 1. 1. 1. 1.]]

[[1. 1. 1. 1. 1. 0. 0. 0. 0. 0.]]
[[0. 0. 0. 0. 0. 1. 1. 1. 1. 1.]]

[[1. 1. 1. 1. 1. 0. 0. 0. 0. 0.]]
[[0. 0. 0. 0. 0. 1. 1. 1. 1. 1.]]

>>> import mxnet as mx
>>> mx.__version__
'1.5.0'

python --version
Python 3.6.5 :: Anaconda, Inc.

replacing
        z1, z2 = F.split(y, 2)
        out1 = self.classifier(z1)
        out2 = self.classifier(z2)

with
        out1 = self.classifier(y[:,:5])
        out2 = self.classifier(y[:,5:])

works as expected, I'm thinking the bug might come from the split operator. @eric-haibin-lin

in case you might have an idea @reminisce @piiswrong @sxjscience

F.split_v2 does not have this bug.

@ThomasDelteil
I ran it on CPU and didn't get core dump. Here is my output:
[[1. 1. 1. 1. 1. 0. 0. 0. 0. 0.]]
[[0. 0. 0. 0. 0. 1. 1. 1. 1. 1.]]

[[1. 1. 1. 1. 1. 0. 0. 0. 0. 0.]]
[[0. 0. 0. 0. 0. 1. 1. 1. 1. 1.]]

[[1. 1. 1. 1. 1. 0. 0. 0. 0. 0.]]
[[0. 0. 0. 0. 0. 1. 1. 1. 1. 1.]]

[[1. 1. 1. 1. 1. 0. 0. 0. 0. 0.]]
[[0. 0. 0. 0. 0. 1. 1. 1. 1. 1.]]

We also have a unit test to cover split operator with gradient:
tests/python/unittest/test_infer_type.py
def test_split()
    data = mx.nd.arange(16, dtype=np.float64).reshape((4, 4))
    data.attach_grad()
    with autograd.record():
        y = mx.nd.split(data, axis=0, num_outputs=2)
    y[0].backward()
    assert data.grad.dtype == np.float64

@apeforest
The test does not seem enough to actual test that backward is working, I would add a check on the values of the actual gradients.
Are you using a mkl version of mxnet?
Are you running the first example or the second? I get the bug on ubuntu with a GPU build and also on my max on CPU build:
> python test.py
/Users/tdelteil/anaconda3/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
[[1. 1. 1. 1. 1. 0. 0. 0. 0. 0.]]
[[ 0.0000000e+00 -4.6566129e-10 -2.9563751e+35 -1.0844662e-19
  -2.9466291e+35  4.6577470e-10 -2.9332078e+35  1.5849492e+29
   7.3657442e+28  1.0597454e-38]]

[[1. 1. 1. 1. 1. 0. 0. 0. 0. 0.]]
[[ 0.00000000e+00 -4.65661287e-10  0.00000000e+00 -4.65661287e-10
   1.16116826e+33  1.78601853e+31  1.49938936e-43  0.00000000e+00
   0.00000000e+00  0.00000000e+00]]

[[1. 1. 1. 1. 1. 0. 0. 0. 0. 0.]]
[[ 0.0000000e+00 -4.6566129e-10 -2.9551057e+35 -2.5249697e-29
   4.2038954e-45  0.0000000e+00 -6.4196971e-16  4.5826664e-41
   0.0000000e+00 -4.6566129e-10]]

python(78676,0x7fffb122c3c0) malloc: *** error for object 0x7fbfa3e432f8: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
Abort trap: 6

split has a bug, and it always concatenates the in_grad by dim 1.
However, it still has problem when I fix it.

The bug couldn't be reproduced in this test case.
import mxnet as mx
from mxnet.test_utils import assert_almost_equal
import numpy as np

split_list = [1, 2, 3, 4]
siz = np.prod(split_list)
shape = (siz, siz, siz, siz)
for axis in range(len(split_list)):
    for num_outputs in split_list:

        data = mx.nd.arange(np.prod(shape)).reshape(shape)
        data.attach_grad()

        with mx.autograd.record():
            sp = mx.nd.split(data=data, num_outputs=num_outputs, axis=axis)
            if isinstance(sp, mx.nd.NDArray):
                sp = [sp]
            assert len(sp) == num_outputs, (len(sp), num_outputs)
            loss = mx.nd.sum(mx.nd.stack(*[s * mx.nd.arange(s.size).reshape_like(s) * (i + 1) for i, s in enumerate(sp)], axis=axis))
        loss.backward(retain_graph=True)

        part_len = data.shape[axis] // num_outputs
        grad = data.grad
        for i in range(num_outputs):
            index = [slice(None)] * data.ndim
            index[axis] = slice(i * part_len, (i + 1) * part_len)
            index = tuple(index)
            assert_almost_equal(data[index].asnumpy(), sp[i].asnumpy(), atol=0, rtol=0)
            grad_i = grad[index].asnumpy()
            assert_almost_equal(grad_i, np.arange(grad_i.size).reshape(grad_i.shape) * (i + 1), atol=0, rtol=0)

@ThomasDelteil
I tried running code  on my mac ,
import mxnet as mx
from mxnet import gluon, autograd, nd

for i in range(1):
    ctx = mx.cpu()
    data = mx.nd.ones((1,10,), ctx=ctx)
    param = mx.nd.ones((1,10,), ctx=ctx)
    data.attach_grad(grad_req='write')
    param.attach_grad(grad_req='write')
    with autograd.record():
        z = data*param
#        print(z.shape())
        z1, z2 = z.split(2,1)
        #z1, z2 = z[:,:5], z[:,5:]
    z1.backward(retain_graph=True)
    print(data.grad.asnumpy())
    z2.backward(retain_graph=True)
    print(data.grad.asnumpy())
    print()
    break

The results I get is :
[[1. 1. 1. 1. 1. 0. 0. 0. 0. 0.]]
[[ 0.0000000e+00  2.0000000e+00  2.5715471e+36 -4.6577453e-10
   1.6986417e-14  3.6433760e-44  4.8807685e+13  6.0397474e+26
   4.3427447e-20  1.4012985e-45]]

I guess, the expected output of  print(data.grad.asnumpy()) is :
[[0. 0. 0. 0. 0. 1. 1. 1. 1. 1.]]
Can you confirm my understanding is correct ?
I also verified that split_v2 is giving correct results ?

Yes your understanding is correct
On Tue, Apr 16, 2019, 01:14 Vikas89<EMAIL_ADDRESS>wrote:

@ThomasDelteil https://github.com/ThomasDelteil
I tried running code on my mac ,
import mxnet as mx
from mxnet import gluon, autograd, nd
for i in range(1):
ctx = mx.cpu()
data = mx.nd.ones((1,10,), ctx=ctx)
param = mx.nd.ones((1,10,), ctx=ctx)
data.attach_grad(grad_req='write')
param.attach_grad(grad_req='write')
with autograd.record():
z = data*param
print(z.shape())
    z1, z2 = z.split(2,1)
    #z1, z2 = z[:,:5], z[:,5:]
z1.backward(retain_graph=True)
print(data.grad.asnumpy())
z2.backward(retain_graph=True)
print(data.grad.asnumpy())
print()
break

The results I get is :
[[1. 1. 1. 1. 1. 0. 0. 0. 0. 0.]]
[[ 0.0000000e+00  2.0000000e+00  2.5715471e+36 -4.6577453e-10
1.6986417e-14  3.6433760e-44  4.8807685e+13  6.0397474e+26
4.3427447e-20  1.4012985e-45]]
I guess, the expected output of print(data.grad.asnumpy()) is :
[[0. 0. 0. 0. 0. 1. 1. 1. 1. 1.]]
Can you confirm my understanding is correct ?
I also verified that split_v2 is giving correct results ?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/apache/incubator-mxnet/issues/14340#issuecomment-483452493,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ADi006X2XmIdyi4bsdFM_XxFFmZjhOZyks5vhQfAgaJpZM4bf3pq
.

Ok, the root cause for this is we have a caching in nnvm::legacy_op_util, on first backward pass the data will be inititalized, on next backward pass, split backward gets junk data.
If I defeat  caching here: https://github.com/apache/incubator-mxnet/blame/master/src/nnvm/legacy_op_util.cc#L146
by making bwd_init_ = false , I get expected output.
Not sure what was the reason to introduce caching and if what is the consequences if we just remove it.
@tqchen : by any chance do you remember and if it is safe to remove caching ?


client-subnet-always-forward seems to effectively bypass any caching?

From the documentation, I assumed that client-subnet-always-forward was basically the same as setting send-client-subnet: <IP_ADDRESS>/0 - in terms of upstream functionality of sending ECS upstream it seems to be. However when deploying to a live environment I noticed that there was basically no caching going on. Reading through the code it seems to be that this is the case. From the documentation I did not expect this, but it seems to be written like this in the code comments. Is it possible to clarify in the documentation as to exactly what this option does please?

Yes, certainly, it already reads, in the section for subnet that The option will always be forwarded, regardless the allowed addresses, if client-subnet-always-forward is set to yes. In this case the lookup in the regular cache is skipped.
So I added a commit that adds this text to the documentation for the client-subnet-always-forward option: And the lookup in the regular cache is skipped.

Yes, certainly, it already reads, in the section for subnet that The option will always be forwarded, regardless the allowed addresses, if client-subnet-always-forward is set to yes. In this case the lookup in the regular cache is skipped.
So I added a commit that adds this text to the documentation for the client-subnet-always-forward option: And the lookup in the regular cache is skipped.


Ensure os.getMaxSatisfyingVersion returns exact results for exact matches

Fix for #422. This is a quick patch so we can get the production issue fixed in resin-cli - in time we should do this more thoroughly and carefully in resin-semver as part of fully integrating that (#390). The tests can stay in here regardless, which should provide an easy framework for those changes later.
Change-Type: patch

(Merging & releasing issues are caused by github status problems: https://status.github.com/messages. I'll have another go in a bit)


Extract getFromCacheOrExecuteAndCache utility function

Summary
Changes

Pull Request Test Coverage Report for Build<PHONE_NUMBER>9
Details

6 of 24 (25.0%)  changed or added relevant lines in 2 files are covered.
1 unchanged line in 1 file lost coverage.
Overall coverage decreased (-0.005%) to 48.449%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

src/datasources/accounts/accounts.datasource.ts
1
5
20.0%

src/datasources/db/cached-query-resolver.ts
5
19
26.32%

Files with Coverage Reduction
New Missed Lines
%

src/datasources/accounts/accounts.datasource.ts
1
15.87%

Totals

Change from base Build<PHONE_NUMBER>1:
-0.005%

Covered Lines:
4328

Relevant Lines:
7202

💛  - Coveralls


post-deploy didn't use environment variables

Hi!
Not sure if bug but..
So, there is  "env"  : {  ...   } block in every deploy targets in ecosystem.json but even if something is specified there, it doesn't applied to post-depoy command hook.
Here is use-case: I have post-deployment scripts, i.e migrations which have to be executed before application is started just after deploy. And this scripts  are using same config system which takes db connection credentials from env variables.
It would be great if env variables from ecosystem will be injected not only for apps but for all hooks too.
Thank you and sorry for bad english

you can do this until they fix it
"post-deploy": "export NODE_ENV=production && yarn install && npm run bundle && npm run db:update && pm2 reload ecosystem.config.js --env production"

i think that the problem can be around this line: https://github.com/Unitech/pm2-deploy/blob/master/deploy.js#L16
if i have time i will try to debug it.
it seems to me that the environment variable are not being passed to the shell command being executed.

Similar problem here. pm2 deploy my_server wasn't able to start app with nvm ([PM2][ERROR] NVM is not available in PATH). I have to export NVM_DIR=/home/me/.nvm in post-deploy script. When I execute pm2 start ecosystem.config.js from my_server shell NVM_DIR variable works as expected.

sorry i forgot to check this bug. if i can i will try in these day to fix the issue.

i finally had time to debug the issue. i've added a way to pass the env declared in each <env> in the deploy section. let's have a look at #152 and start a discussion about this feature.


Quality widget - Display critical open-source violations - UI

This PR will add functionality to display "Critical" open source violations in quality widget. Changes includes UI only. Follow up PR required in API (LibraryPolicyThreatLevel.java) to pull critical issues.

@tabladrum LGTM


🚀 Feature: Migrate update and create chatbot pages

🔖 Feature description
Migrate Update and Create chatbot pages
🎤 Why is this feature needed ?
React Migration
✌ How do you aim to achieve this?
React
🔄 Additional Information
No response
👀 Have you spent some time to check if this feature request has been raised before?

[X] I checked and didn't find similar issue

Are you willing to submit PR?
Yes I am willing to submit a PR!

This is done I think as dialogs


geometry_virtualenv is hard to read.

While reading through the functions one of them popped out like a sore thumb, and it was the geometry_virtualenv.
Thoughts?

How does this look https://github.com/jedahan/geometry/commit/2ddf1f599407e0a07dd7dce5efeb41321d1a34d6 ?

Beautiful. Good job my friend.


html formatted emails

I see that html formatted emails are supported but I don't see how to turn it on.  Can you point to where the setting is?

You'd need to really build your own message formatter. The built-in formatting is really there for development/illustration.

I've already implemented a CustomEmailMessageFormatter based on your example to handle localized emails.  How can I take that to the next level and make them html?  Seems like I'd have to customize EmailEventHandler.  Is that possible?  Can you provide some guidance if that's the way to go?

Use the SmtpMessageDelivery and set sendAsHtml to true. If you don't want that, then implement your own IMessageDelivery with the EmailEventHandler. If you don't use any of those, then you can just do that yourself in your own event handler.

Thank Brock.  That was easier than I thought.
var delivery = new SmtpMessageDelivery();
delivery.SendAsHtml = true;
config.AddEventHandler(new EmailAccountEventsHandler<CustomUserAccount>(emailFormatter, delivery));

Now all I have to do it redo all those message bodies :-)


Remove Rails dependencies and switch to RSpec

It appears that Rails was being used only to test the gem. Using RSpec instead simplifies things and Rails shoudln't be needed as a dependency anymore.
We can now use recent versions of ActiveSupport.

This change makes sense to me. I'll release a new version shortly. Thanks for the contribution @awead!

@corylown sweet! Thanks for the quick turnaround!


GSSOC EXT NOTICE: Improper Labeling in the Project

Dear Project Admin, picwise.co
It has come to our attention that your repository not applying the necessary labels to issues and merged PRs, which is affecting contributor scores on the leaderboard.
Please ensure you use the correct labels:
gssoc-ext
level1, level2, level3
hacktoberfest-accepted (only if your repository have Hacktoberfest topic in description)
NOTE: Level labels should not have any dashes between them. Spaces are allowed, but no dashes should be used.
Kindly review and update the labels on your issues and PRs to ensure fairness for all contributors. Failure to address this may result in your project being flagged.
Thank you,
Core Team
GSSoC '24 Extended

@AKSHITHA-CHILUKA thanks for getting back, i've fixed the label issues now. Do let me know if there's still some changes needed to be done, thanks!

Its not gssoc its gssoc-ext please remove gssoc label and add the correct one

also make sure all the pr's should have gssoc-ext label and level label then only your contributors will get points , also please be active and assign issues and merge the pr's


Xamarin UWP Release, FromResource crash

🐛 Bug Report
I found a bug in Xamarin UWP Release, and I documented on your wiki the solution.
Please move the wiki to the README. The documentation should be version controlled. ANd people should not be allowed to modify the wiki.
I have updated your wiki as below:
https://github.com/luberda-molinet/FFImageLoading/wiki/SVG-support
"
On Xamarin UWP, in Release mode with .NET Native compilation activated, the function SvgImageSource::FromResource() will not work for auto-detecting the calling assembly. You need to pass the assembly containing the resources as a parameter.
GetCallingAssembly() does not work because System.Reflection is altered by the Native compilation.
// example of solution: using System.Reflection; // [...] if (Runtime.IsUWP()) { // this fixes the bug that GetCallingAssembly() throws an exception in Release mode for UWP Assembly sourceAssembly = typeof(CurrentClassNameWithResourcesInSameAssembly).GetTypeInfo().Assembly; return SvgImageSource.FromResource(resourcePath, sourceAssembly); }
"
Expected behavior
Reproduction steps
Configuration
Version: 1.x
Platform:

[ ] :iphone: iOS
[ ] :robot: Android
[ ] :checkered_flag: WPF
[ ] :earth_americas: UWP
[ ] :apple: MacOS
[ ] :tv: tvOS
[ x] :monkey: Xamarin.Forms

Too old I close


Report Portal showing incorrect Status as Failed though all Tests Passed

Report Portal showing the Status as FAIL though all my Tests were Passed which are executed by Newman.
Anyone faced similar issue and appreciate your help on this.

Hello @itsram113 !
Fixed in version 5.0.3.