Vernemq crashes when a large number of clients try to connect simultaneously

To help us save time and help you faster
Before opening a new issue, please make sure that isn't already an open (or
closed/resolved) issue concerning the problem. If unsure if older issues are
about the exact same thing, just open a new issue rather than posting in the old
one - but please reference the possibly related issues in the new issue.
Please do not insert images of text, but insert the text instead.
Environment

VerneMQ Version: 1.9.2
OS: Ubuntu 18.04.2 LTS
Erlang/OTP version (if building from source): 22
VerneMQ configuration (vernemq.conf) or the changes from the default

vernemq.txt

Cluster size/standalone: 3 nodes

Expected behavior

Please describe the expected behaviour.
Vernemq should not crash

Actual behaviour
2019-11-16 11:02:26 =ERROR REPORT====
Error in process <0.5739.1599> on node<EMAIL_ADDRESS>with exit value:
{{case_clause,{badrpc,nodedown}},[{vmq_reg,'-register_subscriber_/6-fun-0-',2,[{file,"/opt/vernemq/apps/vmq_server/src/vmq_reg.erl"},{line,195}]},{vmq_reg,block_until,4,[{file,"/opt/vernemq/apps/vmq_server/src/vmq_reg.erl"},{line,276}]},{vmq_reg,register_subscriber_,6,[{file,"/opt/vernemq/apps/vmq_server/src/vmq_reg.erl"},{line,217}]},{vmq_reg_sync_action,'-init/1-fun-0-',1,[{file,"/opt/vernemq/apps/vmq_server/src/vmq_reg_sync_action.erl"},{line,52}]}]}
2019-11-16 11:02:26 =CRASH REPORT====
crasher:
initial call: vmq_ranch:init/4
pid: <0.11305.1633>
registered_name: []
exception error: {{case_clause,{{case_clause,{badrpc,nodedown}},[{vmq_reg,'-register_subscriber_/6-fun-0-',2,[{file,"/opt/vernemq/apps/vmq_server/src/vmq_reg.erl"},{line,195}]},{vmq_reg,block_until,4,[{file,"/opt/vernemq/apps/vmq_server/src/vmq_reg.erl"},{line,276}]},{vmq_reg,register_subscriber_,6,[{file,"/opt/vernemq/apps/vmq_server/src/vmq_reg.erl"},{line,217}]},{vmq_reg_sync_action,'-init/1-fun-0-',1,[{file,"/opt/vernemq/apps/vmq_server/src/vmq_reg_sync_action.erl"},{line,52}]}]}},[{vmq_mqtt_fsm,check_user,2,[{file,"/opt/vernemq/apps/vmq_server/src/vmq_mqtt_fsm.erl"},{line,544}]},{vmq_mqtt_fsm,init,3,[{file,"/opt/vernemq/apps/vmq_server/src/vmq_mqtt_fsm.erl"},{line,148}]},{vmq_mqtt_pre_init,data_in,2,[{file,"/opt/vernemq/apps/vmq_server/src/vmq_mqtt_pre_init.erl"},{line,66}]},{vmq_ranch,handle_message,2,[{file,"/opt/vernemq/apps/vmq_server/src/vmq_ranch.erl"},{line,195}]},{vmq_ranch,loop_,1,[{file,"/opt/vernemq/apps/vmq_server/src/vmq_ranch.erl"},{line,138}]},{proc_lib,init_p_do_apply,3,[{file,"proc_lib.erl"},{line,249}]}]}
ancestors: [<0.1237.0>,<0.1139.0>,ranch_sup,<0.136.0>]
message_queue_len: 0
messages: []
links: [#Port<0.1877544>,<0.1237.0>]
dictionary: [{atomics_ref,#Ref<0.2045984191.1446379521.177506>},{rand_seed,{#{jump => #Fun<rand.16.10897371>,max =><PHONE_NUMBER>51711743,next => #Fun<rand.15.10897371>,type => exsplus},[68264097561321310|334067051495824]}},{max_msg_size,0}]
trap_exit: true
status: running
heap_size: 2586
stack_size: 27
reductions: 8796
neighbours:
2019-11-16 11:02:26 =ERROR REPORT====

Please include minimal steps to reproduce the issue, if possible.
This is see when a large number of clients try to connect to the broker at the same time

Hi, could you describe more in detail what you're doing when experiencing this? What is a large number of clients here? I would expect to be some errors previous to the one you list above. The nodedown error comes when the node is already down, so this indicates that another node than the one where this log came from is down, it would be interesting to know what the logs from that node looks like.
But usually if things go down when connecting many clients, then that's a sign that the system is overloaded and needs tuning (or simply less load).
Hope this helps

We are running 3 nodes on AWS. Instance size is c4.2xlarge. Here are the logs from all the 3 nodes.
vernemq-node-1.zip
vernemq-node-2.zip
vernemq-node-3.zip

Hi, could you describe what you're doing? How many connections etc?

We have MQTT clients installed on our mobile apps connect to VerneMQ as soon as our App is launched. We are using webhooks for authentication. The problem is generally seen when we send out push notifications to our users since a push notification will generally result in a large number of users opening our app and our app tries to connect to VerneMQ. We need to support 100K concurrent connections.

@larshesel Do you an any update on this ? Need any other information

Hi,
I took a quick look at the logs and I don't see a root cause for the badrpc/nodedown. Could it be that your network is simply not very stable? Or perhaps the nodes are too busy/overloaded to respond?
In any case you have lots of errors from the webhook plugin:
2019-11-18 12:39:09.086 [error] <0.6103.2587>@vmq_webhooks_plugin:call_endpoint:607 calling endpoint failed due to {invalid_response_code,422}
2019-11-18 12:39:09.090 [error] <0.10132.4203>@vmq_webhooks_plugin:call_endpoint:607 calling endpoint failed due to {invalid_response_code,500}
2019-11-18 12:39:09.105 [error] <0.29037.2069>@vmq_webhooks_plugin:call_endpoint:607 calling endpoint failed due to {invalid_response_code,500}
2019-11-18 12:39:09.162 [error] <0.16213.3778>@vmq_webhooks_plugin:call_endpoint:607 calling endpoint failed due to {invalid_response_code,422}
2019-11-18 12:39:09.284 [error] <0.14940.2319>@vmq_webhooks_plugin:call_endpoint:607 calling endpoint failed due to {invalid_response_code,500}
2019-11-18 12:39:09.293 [error] <0.14614.165>@vmq_webhooks_plugin:call_endpoint:607 calling endpoint failed due to {invalid_response_code,500}
2019-11-18 12:39:09.319 [error] <0.35.1631>@vmq_webhooks_plugin:call_endpoint:607 calling endpoint failed due to {invalid_response_code,500}
2019-11-18 12:39:09.410 [error] <0.3752.332>@vmq_webhooks_plugin:call_endpoint:607 calling endpoint failed due to {invalid_response_code,422}
2019-11-18 12:39:09.433 [error] <0.27021.2171>@vmq_webhooks_plugin:call_endpoint:607 calling endpoint failed due to {invalid_response_code,422}
2019-11-18 12:39:09.445 [error] <0.16122.3898>@vmq_webhooks_plugin:call_endpoint:607 calling endpoint failed due to {invalid_response_code,500}
2019-11-18 12:39:09.480 [error] <0.23234.3163>@vmq_webhooks_plugin:call_endpoint:607 calling endpoint failed due to {invalid_response_code,422}
2019-11-18 12:39:09.480 [error] <0.17313.4051>@vmq_webhooks_plugin:call_endpoint:607 calling endpoint failed due to {invalid_response_code,500}
2019-11-18 12:39:09.507 [error] <0.8968.3240>@vmq_webhooks_plugin:call_endpoint:607 calling endpoint failed due to {invalid_response_code,500}
2019-11-18 12:39:09.515 [error] <0.15138.3965>@vmq_webhooks_plugin:call_endpoint:607 calling endpoint failed due to {invalid_response_code,422}

Which you should probably look into/get cleaned up.
If you can reproduce this again then it would help if you could first remove the old logs and give a detailed description of exactly what is happening/what is being done to the system when the first errors occur.
Hope this helps.


Update to Slurm 19.05

Fixes #9
Supersedes #27

This is a breaking change and so will be merged into a new version branch, 4.


Repost of the Grafana Labs blog post.

Signed-off-by: Matt Ray<EMAIL_ADDRESS>

The Grafana Labs blog URL needs to be added before merging.

@mattray When you're on, we do have an ask to update the article to attribute myself and @jjo as authors. I can create an issue if you'd prefer


Show Verse Labels in Condensed View

When using B.show with condenseType=clause the verse label no longer appears. This is undesirable since the reference is an important coordinate, regardless of whether the whole verse is displayed.

Seems perfectly reasonable to me. I think I'll add an option (withPassage=True) to provide the passage of the first slot in the result tuple.

The logic of providing a passage label to a plain / pretty display. There will be a new argument: withPassage=True

if the node is a section node, it will have a passage label in its representation, withPassage has no effect
all other nodes: the reference node is the first slot "under it".
withPassage is True: the passage label of the reference node will be produced.
in plainTuple and prettyTuple:

in uncondensed mode:
the reference node will be taken from the node that is "linked", if any, otherwise the first node
in condensed mode:
the reference node will be taken from the container nodes

Done


Update angular to v15 and fix upcomming errors

I just updated angular to v15 and replaced some things which were deprecated or legacy-components.

Thanks for your small tutorial, it helped a bunch but it was a bit outdated so I tried to update this project first and then implement it into my own. And since I already updated this project, I thought I could contribute that work to the original.

Thanks Tom, let me check it out and get back to you :)
On Wed, Feb 8, 2023 at 5:24 PM Tom Wegener @.***> wrote:

Thanks for your small tutorial, it helped a bunch but it was a bit
outdated so I tried to update this project first and then implement it into
my own. And since I already updated this project, I thought I could
contribute that work to the original.
—
Reply to this email directly, view it on GitHub
https://github.com/thisiszoaib/angular-dark-mode/pull/1#issuecomment-1422513421,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ADCGLR4FWXIKHEGTN42XFLDWWOGBHANCNFSM6AAAAAAUVGAOEY
.
You are receiving this because you are subscribed to this thread.Message
ID: @.***>

@tom-wegener The update has also messed with the layout quite a bit. So if you can get it to be like it was before, I'll be happy to merge. Otherwise, will have to pass.

Okay, I'll revert it back.


Quantity can be changed to a decimal

When editing the cart - you can change the qty to a decimal. This also causes errors

I wonder if this could actually be a 'feature' if it was fixed to work and be an option.
I've seen some online shops sell stuff by the kilo, where you could type in a decimal.
e.g. http://shop.beerbelly.com.au/barrett-burston-ale-5-ebc.html
Just a thought!

If so, then it's an option that HAS to be set at the product level. The same store that's selling grains and t-shirts will not want to sell 1.65 of a t-shirt.


Docker image build fails with nodejs install error

This was working fine yesterday, today not so much. Will have to see if the dependency has to be updated or if this is e.g. some random network issue. Dump of error in comments.

Fixed by upgrading to nodejs v18.


Ecto Result Command in Telemetry

Hi, it seems that ecto: does not include the command parameter un the result atom when using telemetry according to this article https://elixirschool.com/blog/instrumenting_phoenix_with_telemetry_part_three/:
def metrics do
  [
    summary(
      "quantum.repo.query.total_time",
      unit: {:native, :millisecond},
      tag_values: &__MODULE__.query_metadata/1,
      tags: [:source, :command]
    )
  ]
end

def query_metadata(%{source: source, result: {_, %{command: command}}}) do
  %{source: source, command: command}
end

I am currently using:
      {:phoenix_ecto, "~> 4.1"},
      {:ecto_sql, "~> 3.4"},
      {:myxql, ">= 0.0.0"},

The parameter will be in the metadata. You can see it in the logs and the logs are using the same metadata to log.

Hi @josevalim using the Telemetry.Metrics.ConsoleReporter, I'm no able to see the command value, nor in the metadata, nor anywhere. Could it be because I'm using the MyXQL connector?

Here is the metadata: https://github.com/elixir-ecto/ecto_sql/blob/master/lib/ecto/adapters/sql.ex#L892-L900
make sure you have all the correct keys :)

Yes, I get the keys, however it seems that the command (INSERT, UPDATE, DELETE) is not provided anymore.
Thnx!


resend verification email

when deploying non locally, a notification is sent to the user for the verification step.
If the notification gets lost, the user can't verify its account.
There should be a command to resend the verification email.

Having some issues with adding a new command which sends an email notification.
Due to #1552 , any email notification command fails, such as signup (fixed in #1651)  or passsword-reset, because the ListUser, GetUser and GetUserByEmail functions in store.go wipe the email using the secureUser function.
So, I cannot get an unverified users email with any of the user commands. @bquenin Can I get some consensus on how we can work around this? Currently, you are blocked from seeing an users emails given your authorization, however, a new user should still be able to re-send their verification email to their email account associated with the account they signed up with.

@JosephGJ I think a GetUserEmail(User *user) string function in amp/data/accounts would solve this issue. It would bypass the email access restriction and would only be called from within amp, i.e. not exposed through the API.
The function would call getUser (private method) and return only the associated email or an empty string in case of error.


Rename _initialised to _finalized

Ref: #1
@calvinmetcalf is this better?

changed in https://github.com/crypto-browserify/hash-base/commit/ea3c00fdf768f68313e07f1d93652316f94d9de9


Add recent work to BRSA

Add group BRSA: shared covariance matrix across subjects.
Add transform and score function
Modify utils.gen_design to make the generated design matrix approximately scaled in amplitude.
Add automatic determination of number of nuisance regressor based on BIC

@lcnature, I left some comments, but we need someone with more BRSA experience looking at the code. Could you please nominate someone?

Thanks Mihai! Either Mike Anderson or Mike Shvartsman is good.
On Mon, Mar 6, 2017, 20:34 Mihai Capotă<EMAIL_ADDRESS>wrote:

@lcnature https://github.com/lcnature, I left some comments, but we
need someone with more BRSA experience looking at the code. Could you
please nominate someone?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/IntelPNI/brainiak/pull/194#issuecomment-284592670,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AHZ3Tf0JI9n-SH-48qw6xelL6Ch7CedGks5rjLRAgaJpZM4MS-18
.

@mshvartsman, @mjanderson09, any chance you can have a look at this PR?

@mihaic I cannot really see which line has wrong indentation from the current report. Can you help on that?

@lcnature, see https://github.com/lcnature/brainiak/pull/2.

Thanks!
Now as I think of it, I am still worried that asking users to choose from
two functions that they do not know might deter some people. "invGamma" is
still something interpretable, at least they know this refers to a form of
distribution. But having to choose from two functions of long names seem
quite scary. How about I make two functions either within or outside BRSA
class, but direct a function of _calc_tau2 to one of them based on the
string argument? If advanced user wants to try a different form of prior
distribution, they can still add one and make a pull request.
I somehow still prefer the possibility of accepting either a string or a
function object, such that for most users, the string argument is easy
enough to guess what it means, and for advanced users, they can write their
own function as long as it has the same interface.
On Thu, Mar 9, 2017 at 7:04 PM, Mihai Capotă<EMAIL_ADDRESS>wrote:

@mihaic commented on this pull request.
In brainiak/reprsimil/brsa.py
https://github.com/IntelPNI/brainiak/pull/194#discussion_r105302276:

       tau2 = (log_SNR_invK_tilde_log_SNR - n_V * self.tau_range**2

               + np.sqrt(n_V**2 * self.tau_range**4 + (2 * n_V + 8)

                         * self.tau_range**2

                         * log_SNR_invK_tilde_log_SNR

                         + log_SNR_invK_tilde_log_SNR**2))\

           / 2 / (n_V + 2)

       log_ptau = scipy.stats.halfcauchy.logpdf(

           tau2**0.5, scale=self.tau_range)

   else:

       tau2 = (log_SNR_invK_tilde_log_SNR + 2 * self.tau_range**2) /\

           (2 * 2 + 2 + n_V)

       log_ptau = scipy.stats.invgamma.logpdf(

           tau2, scale=self.tau_range**2, a=2)

   # LL_inc is  p(tau2)

   return tau2, log_ptau

That is because in Python "default values are evaluated at the point of
function definition":
https://docs.python.org/3/tutorial/controlflow.html#default-
argument-values
Therefore, the function definition must be placed before the class
definition in the module for the function name to be usable as the default
argument value in init.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/IntelPNI/brainiak/pull/194#discussion_r105302276, or mute
the thread
https://github.com/notifications/unsubscribe-auth/AHZ3TZrN-JkCY21aoIlf9wDQlXH0ZFcYks5rkJOpgaJpZM4MS-18
.

@lcnature, this is the same discussion we had for nureg_method. Whatever intuition users can have reading the string "invGamma", they can also have reading the function name, which can be whatever you (as the module designer) choose, including "estimate_inv_gamma". Is that not as intuitive?

@mihaic I don't know. I just have a feeling that for users relatively new to Python, this might create another confusion. I moved the two functions to the top of brsa.py and it worked. But I see that when I hit tab+shift, the usage instruction shown for BRSA shows the default argument like this "tau2_prior=<function prior_GP_std_halfCauchy at 0x7f36ff593ae8>" Think of someone who is used to Matlab, this might appear quite strange and him/her might not guess out how to replace it with another function, and where to find it.
It is true that the user can always find another function within brsa module, or we can point them to try the other prior function in the module. But wouldn't it be complicated that they have to write BRSA(..., tau2_prior=brsa.prior_GP_std_invGamma,...)? Also sometimes user might just do from brsa import BRSA, then it is hard for them to see the extra function within brsa. This function is only used within BRSA, not like svm that can be widely used.

@lcnature, you can address the issues you noticed.
You could name the argument, tau2_prior_fn, to suggest the casual user that it holds a function.
Regarding instructions for alternatives, you should point users to prior_GP_std_inv_gamma in the docstring of tau2_prior_fn, where you document the possible string values now. (Note that you should not add "camelCase" to function names.)
Finally, for the import problem, you can make the functions static function in BRSA, so they are accessible without further imports.

Hi @mihaic I am trying to define it as static method.
So now I place
@staticmethod     def _prior_GP_std_half_cauchy(log_SNR_invK_tilde_log_SNR, n_V, tau_range):         tau2 = (log_SNR_invK_tilde_log_SNR - n_V * tau_range**2                 + np.sqrt(n_V**2 * tau_range**4 + (2 * n_V + 8)                           * tau_range**2                           * log_SNR_invK_tilde_log_SNR                           + log_SNR_invK_tilde_log_SNR**2))\             / 2 / (n_V + 2)         log_ptau = scipy.stats.halfcauchy.logpdf(             tau2**0.5, scale=tau_range)         return log_ptau, tau2
within BRSA class. But how should I write the default argument in __init__? If I just write tau2_prior=_prior_GP_std_half_cauchy, python complains that the function is not defined. If I write tau2_prior=self._prior_GP_std_half_cauchy or tau2_prior=BRSA._prior_GP_std_half_cauchy, then neither self or BRSA is defined. Can you explain how to use a static method within the class?

@lcnature, you can do one of the following:

Use None as default value and set the actual value in the body of __init__.
Move the definition before __init__ and access the function wrapped by the method as prior_GP_std_half_cauchy.__func__ (see https://docs.python.org/3/reference/datamodel.html)
Move the functions to the module level (users would still find the alternative function if you reference it in the parameter docstring).

Also, the names must be public to be accessible to users, so remove the leading _.

@mihaic, let me know when you are happy with the PR from a code quality standpoint and then I'll work through the math / science side of things. @lcnature, do you have a scientific description of the changes written up somewhere? I have a hunch of how GBRSA should work but it would be nice to have math to go with the code.

@mshvartsman Thanks! I have some notes written myself but not in a polished way. Still writing the paper.

@mshvartsman, thanks for helping. The code looks good. There will probably be a few more minor changes, but nothing major.

@mshvartsman, @lcnature, any update?

@lcnature, how is this PR going?

I'm the bottleneck at the moment -- but I'm actually slightly dug out so I will try to get through it this week.

I recommend making GBRSA and BRSA in separate files brsa.py and gbrsa.py. They're distinct methods and I think it should be a bit easier to keep track of what's where if they are distinct (see e.g. srm.py and sssrm.py).

@mihaic The suggestion by @mshvartsman is fine with me. But I wonder what is your suggestion for code organization and user friendliness. FYI, in the long run, I would recommend users to use gbrsa for most usages. But not knowing what disadvantage it might have, I will keep both brsa and gbrsa in place.

If BRSA and GBRSA have the same objective and share code, they should be in the same file, even if this makes the file unusually long.

Hey @cbaldassano, do you mind reviewing just the forward-backward algo in here? I haven't touched HMMs in years and it's probably fresher in your mind than in mine.

The overall logic of _forward_step and _backward_step looks good, though it is hard for me to evaluate the math without seeing a writeup of what it is supposed to be computing.
The code could use some comments, and there are some lines that are commented out (e.g. 1529, 1533-1534) that are unclear if they are important.

Thanks @cbaldassano ! I will send you a pdf of some details of the derivation. And I will add more comments to the code and clean up those unused codes.

I took another look at the forward-backward functions now that I've seen the math, and it looks like they line up correctly. I just made a minor comment about possible modification of the input arguments.

It's great to see all the activity in this PR. Thank you very much for your reviews, @mshvartsman and @cbaldassano!
@lcnature, given the extensive comments from @mshvartsman, I think it would be helpful for you to actually make commits addressing the comments as you reply to the comments, not later. GitHub does not provide a formal way to mark each comment as resolved, but it would be very helpful leave a message such as "Done" for each comment that is addressed.

@mshvartsman All comments are addressed except for 3: changing names of matrices D/F would be done in a future PR to make it easy to check that all other variable names depending on these are changed accordingly. Checking the necessity of annealing will be deferred for now. The code will not do z-scoring of data for the user, but option to z-score the residual for the purpose of determining number of nuisance regressors and calculating these regressors is provided. Thanks!

With addition of tests of the numerical integration code, plus some changes to the eigenvalue cutoff code @lcnature is doing now, I am happy to have this merged. Sorry it took so long.

Thank you, @mshvartsman.
@lcnature, now we only need a blurb for the release notes in a new RST file named "docs/newsfragments/194.feature". It can be as simple as single sentence naming the new method added.

@mihaic Done. Please check it out. Thanks!
Thanks for the careful review @mshvartsman !

Thank you very much for this massive contribution, @lcnature! After keeping you waiting so long for the merge, I hope you find some consolation in knowing you helped us improve the BrainIAK contribution process.


Import Custom Layer

Users should be able to upload their custom layers to deepforge and have them added to the current project

This is just a convenience for copy and pasting the code into a new custom layer

For now, copy-paste works fine. If there are requests for this, I can re-open it and address it directly


[BUG]: Too much long line "remove" / "hide" button

Note : theme used is Anuppicin, maybe it's different with other theme.

Can be fixed using some css with, for example :
[data-gate-id] > .setting-item > .setting-item-info > .setting-item-description {
	max-width: 50em;
	overflow: hidden;
}

sorry, I fixed that but forgot to release. :D


chore: update description to explain definition and serve for targeting update

Current dependencies on/for this PR:

main

PR #203   👈

This comment was auto-generated by Graphite.


Save image issue

When I try to run this code after I build the apk file it errors with "Error: No such file or directory: /sdcard/DCIM/Img/test.jpg". But when I run it with the Tabris.js 2 app it saves the image perfectly fine. Has anyone an idea why?
btw I know that /sdcard isn't the best way but I only need to use it and I know 100% that /sdcard/DCIM/Img exists.
saveButton.on('select', () => {
  fetch(imgUrl)
    .then(res => res.arrayBuffer())
    .then(data => {
      // image is the the file name e.g. test.jpg
      tabris.fs.writeFile('/sdcard/DCIM/Img/' + image, data)
        .then(() => console.log('Saved image as: ' + image))
        .catch(err => console.error(err));
    })
    .catch(err => console.error(err));
});

Yes that was indeed it, thank you very much for these links. I could barely find anything on google about permissions or I was just looking over it. But it's working now, thank you.

Great to hear. :)


Watch throw "ERROR: Value cannot be null." error

I haven't been able to get --watch working. I'm not sure if its something I've added to my code or an update to fable but I'm now getting an error.
I can get everything to compile:
C:\Dev\game2\src\Client>node ./node_modules/fable-compiler/index --symbols FABLE --watch
Start compilation...
Compiled fable_inject.js at 3:03:33 PM
Compiled Fable.Helpers.ReduxHelper.fs at 3:03:33 PM
Compiled Models-586677941.fs at 3:03:33 PM
Compiled Helpers-1239822851.fs at 3:03:33 PM
Compiled Models.Frontend.fs at 3:03:33 PM
Compiled Renderer.fs at 3:03:34 PM
Compiled MapLayer.fs at 3:03:34 PM
Compiled InterfaceActions.fs at 3:03:34 PM
Compiled Helpers.fs at 3:03:34 PM
Compiled Client.fs at 3:03:34 PM
Watching C:\Dev\game2\src\Client

but then when I update a file I get the following:
rename: Renderer.fs at 3:03:38 PM
ERROR: Value cannot be null.
Parameter name: path

I've added some extra logging into fable.js(L287) which returns the following:
{ type: 'ERROR',
  message: 'Value cannot be null.\r\nParameter name: path',
  stack: '   at System.IO.Path.GetFullPathInternal(String path)\r\n   at Fable.FSharp2Fable.Compiler.IsMasked@919.Invoke(String key, FSharpList`1 deps)\r\n   at Microsoft.FSharp.Collections.MapTreeModule.existsOpt[a,b](FSharpFunc`3 f, MapTree`2 m)\r\n   at Microsoft.FSharp.Collections.MapTreeModule.existsOpt[a,b](FSharpFunc`3 f, MapTree`2 m)\r\n   at Microsoft.FSharp.Collections.IEnumerator.next@224[T](FSharpFunc`2 f, IEnumerator`1 e, FSharpRef`1 started, Unit unitVar0)\r\n   at Microsoft.FSharp.Collections.IEnumerator.filter@219.System-Collections-IEnumerator-MoveNext()\r\n   at Microsoft.FSharp.Collections.IEnumerator.choose@202.System-Collections-IEnumerator-MoveNext()\r\n   at Microsoft.FSharp.Collections.Generator.Microsoft-FSharp-Collections-Generator-Generator-1-get_Apply@542-1.Invoke(Unit unitVar0)\r\n   at Microsoft.FSharp.Collections.Generator.appG[a](Generator`1 g)\r\n   at Microsoft.FSharp.Collections.Generator.EnumeratorWrappingLazyGenerator`1.System-Collections-IEnumerator-MoveNext()\r\n   at Microsoft.FSharp.Collections.IEnumerator.map@111.DoMoveNext(b& )\r\n   at Microsoft.FSharp.Collections.IEnumerator.MapEnumerator`1.System-Collections-IEnumerator-MoveNext()\r\n   at Microsoft.FSharp.Collections.SeqModule.Fold[T,TState](FSharpFunc`2 folder, TState state, IEnumerable`1 source)\r\n   at Fable.Client.Node.Main.compile(ICompiler com, FSharpChecker checker, FSProjectInfo projInfo)' }

It seems a null values is being passed here but I wonder why. It's also strange that when you update the file the event is rename (should be change). Are you just editing and saving the file or do you rename, move it? Also, you're on Windows right? (I heard that node's default watcher doesn't work well on Windows, maybe we should use another tool).

Yeah, I'm on windows. I'm editing, saving the file in VS2015. Oddly if I edit the file in a different editor (Say VS Code) I get:
Watching C:\Dev\game2\src\Client
change: Renderer.fs at 3:44:28 PM
ERROR: Value cannot be null.
Parameter name: path

I have a feeling it's todo with the fable_inject.js (or plugins).  If I remove the "plugins" from my fableconfig.json the watch springs back into life.

Perfect, thanks for the info :+1: I'll try to reproduce the problem creating a project with some code injections.

Ok, this happened because I was sloppy and used null for a string value instead of None (this is supposedly why we program in F#, right? :wink:). It should be fixed now in master, could you give it a try?

That seems to have done the trick,  Thanks for your help.


Final RFC Document

Update RFC as necessary based upon feedback from RFC draft. Submit once completed.

just made some edits and highlighted areas that we need to update as we establish rpi/web client and other details.

need a few fixes by yasha and jawad, but otherwise updated from feedback


Create named collection of queries.

Each collection can have subfolders within it.
Each collection can be named, duplicated, exported.

[x] Create new side menu
[x] Move side menu to app level
[x] Create collections component
[x] Delete collection
[x] Delete query from collection
[ ] Duplicated collection
[ ] Export collection
[x] Edit collection

Store collection data in indexedDb.
http://dexie.org/
Parse markdown.
https://www.npmjs.com/package/ngx-md

Name of collection
Description of collection
Groups (folders) of queries
Name of query
Description of query
Query (query, headers, variables, URL, subscription)

// collection
{
  title: '',
  description: '', // markdown support
  collections: [], // collection[]
  queries: [{ title: '', description: '', ...query }],
  created_at: null,
  updated_at: null
}

Hi, here are some thoughts.

It would be nice to have 2 buttons (or one with dropdown) to have the option to "save" or "save as". "Save" would work the same was as now if the query is not in a collection but if in a collection already, it would overwrite it without prompt. "Save as" would always prompt. This way it could be used to copy the query to another collection.
A way to delete a query from the collection would be welcomed.
A way to delete a collection would be welcomed.
Having the headers, variables and subscriptions scoped per collections would be a nice addition.

Thank you.

@kurisutofu How do you mean by "scoping headers, variables and subscriptions per collection"? Currently a query comprises of the actual query, headers, variables and URL attached to it, so when they are added to a collection, they are stored in the same way too.

@imolorhe , I just noticed it was true ... I'll update the comment ;)

Hi,
Another one.

Saving a query with the same name in the same collection does not overwrite the existing query and creates duplicate. Added to the inability to remove a query, this means we need to have duplicates or write the full query from the get-go.

@kurisutofu I am not really sure I understand the last point. Are you asking if having a query in a collection would overwrite another query with the same name in that collection?

@ivan-kolmychek The delete tasks have been done. They would be available in the next version.

@imolorhe It would be nice to sort the names of the queries per collection. This would be useful for query collections that follow a certain workflow for their GraphQL application.

I'm almost done creating a Feature request for exporting collection but it seems already mentioned here.
It'll be a great help. Let me have a tactical dot here incase of updates :+1:

@klawingco I added that initially but no one mentioned it so I wasn't sure if anyone wanted it. Good to know someone is interested in it 😄


The PostgreSQL engine requires cgo. Please set CGO_ENABLED=1

Version
1.17.2
What happened?
sqlc was installed by this:
go install github.com/kyleconroy/sqlc/cmd/sqlc@latest

Used
sqlc generate

As result got messages that I should set CGO_ENABLED=1.
Expected to generate go code.
Relevant log output
output:
db/migrations/0001_init.up.sql:1:1: the PostgreSQL engine requires cgo. Please set CGO_ENABLED=1.
db/migrations/0002_ad.up.sql:1:1: the PostgreSQL engine requires cgo. Please set CGO_ENABLED=1.
db/migrations/0003_file.up.sql:1:1: the PostgreSQL engine requires cgo. Please set CGO_ENABLED=1.
db/migrations/0004_ad_attachment.up.sql:1:1: the PostgreSQL engine requires cgo. Please set CGO_ENABLED=1.
db/migrations/0005_messenger.up.sql:1:1: the PostgreSQL engine requires cgo. Please set CGO_ENABLED=1.

go env:
GO111MODULE=""
GOARCH="amd64"
GOBIN=""
GOCACHE="/home/admin/.cache/go-build"
GOENV="/home/admin/.config/go/env"
GOEXE=""
GOEXPERIMENT=""
GOFLAGS=""
GOHOSTARCH="amd64"
GOHOSTOS="linux"
GOINSECURE=""
GOMODCACHE="/home/admin/go/pkg/mod"
GONOPROXY=""
GONOSUMDB=""
GOOS="linux"
GOPATH="/home/admin/go"
GOPRIVATE=""
GOPROXY="https://proxy.golang.org,direct"
GOROOT="/usr/local/go"
GOSUMDB="sum.golang.org"
GOTMPDIR=""
GOTOOLDIR="/usr/local/go/pkg/tool/linux_amd64"
GOVCS=""
GOVERSION="go1.19.7"
GCCGO="gccgo"
GOAMD64="v1"
AR="ar"
CC="gcc"
CXX="g++"
CGO_ENABLED="1"
GOMOD="/mnt/e/qfbi/go.mod"
GOWORK=""
CGO_CFLAGS="-g -O2"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-g -O2"
CGO_FFLAGS="-g -O2"
CGO_LDFLAGS="-g -O2"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -m64 -pthread -Wl,--no-gc-sections -fmessage-length=0 -fdebug-prefix-map=/tmp/go-build4211620203=/tmp/go-build -gno-record-gcc-switches"

Database schema
No response
SQL queries
No response
Configuration
No response
Playground URL
No response
What operating system are you using?
Linux
What database engines are you using?
PostgreSQL
What type of code are you generating?
Go

same here

Was having the same issue. Installed homebrew for linux, then ran brew install sqlc. Now the sqlc generate works fine.

@m1ker1n Can you give us a bit more information about the Go installation you're using? I'm confused because go env claims that CGO_ENABLED is set to true.

Same error here using windows WSL2

same issue WSL ubuntu 22.04
go version 1.20.6 linux/amd64
go install .../sqlc
my go env VGO_ENABLED=1
but it still keeps giving the same error that I should enable CGO_ENABLED flag

Same for me. I installed Go via rtx — which is roughly the same as unpacking and adjusting the PATH environment variable.
$ sqlc generate
database/migrations/20230725205802_schema_setup.sql:1:1: the PostgreSQL engine requires cgo. Please set CGO_ENABLED=1.

$ go env
GO111MODULE=""
GOARCH="amd64"
GOBIN=""
GOCACHE="/home/x80486/.cache/go-build"
GOENV="/home/x80486/.config/go/env"
GOEXE=""
GOEXPERIMENT=""
GOFLAGS=""
GOHOSTARCH="amd64"
GOHOSTOS="linux"
GOINSECURE=""
GOMODCACHE="/home/x80486/.cache/go-path/pkg/mod"
GONOPROXY=""
GONOSUMDB=""
GOOS="linux"
GOPATH="/home/x80486/.cache/go-path"
GOPRIVATE=""
GOPROXY="https://proxy.golang.org,direct"
GOROOT="/home/x80486/.local/share/rtx/installs/go/1.20.6/go"
GOSUMDB="sum.golang.org"
GOTMPDIR=""
GOTOOLDIR="/home/x80486/.local/share/rtx/installs/go/1.20.6/go/pkg/tool/linux_amd64"
GOVCS=""
GOVERSION="go1.20.6"
GCCGO="gccgo"
GOAMD64="v1"
AR="ar"
CC="gcc"
CXX="g++"
CGO_ENABLED="1" <--- Already set to 1
GOMOD="/home/x80486/********/go.mod"
GOWORK=""
CGO_CFLAGS="-O2 -g"
CGO_CPPFLAGS=""
CGO_CXXFLAGS="-O2 -g"
CGO_FFLAGS="-O2 -g"
CGO_LDFLAGS="-O2 -g"
PKG_CONFIG="pkg-config"
GOGCCFLAGS="-fPIC -m64 -pthread -fno-caret-diagnostics -Qunused-arguments -Wl,--no-gc-sections -fmessage-length=0 -fdebug-prefix-map=/tmp/go-build935092697=/tmp/go-build -gno-record-gcc-switches"

$ uname -a
Linux uplink 6.1.39-1-lts #1 SMP PREEMPT_DYNAMIC Wed, 19 Jul 2023 17:58:31 +0000 x86_64 GNU/Linux

I installed sqlc using go install github.com/sqlc-dev/sqlc/cmd/sqlc@latest.

anyone found a workaround for this?

For anyone around here using WSL. I tried the go command with sudo one day and it started working out of nowhere🤦♂. might be as simple as that, try it.

Switch to docker version 🙌

had this issue 2 times on WSL debian and a chromebook debian linux environment,
-installed package  build-essential (is not installed on default in these environments).
-then removed the binary and reinstalled and it worked.
somehow the first time I installed on both systems it installed fine without the build-essential package but throws at me this error, but when I tried reinstalling it without the package in the system the install didn't finish and it throwed an error at me for a missing c library.
-go version 1.21, sqlc version 1.20
-I installed this package also not sure tho (libc-dev)
hope this helps.

I encountered this issue on WSL and ChromeOS linux environment.
the issue occurred when CGO_ENABLED was 0 when I installed sqlc and turning it on afterwards didn't help.
I was able to reproduce it here are some logs:
$ go env -w CGO_ENABLED=0
$ go env CGO_ENABLED
0
$ go install github.com/sqlc-dev/sqlc/cmd/sqlc@latest
$ go env -w CGO_ENABLED=1
$ sqlc generate
package database
sql/schema/001_users.sql:1:1: the PostgreSQL engine requires cgo. Please set CGO_ENABLED=1.
sql/schema/002_users_apiKeys.sql:1:1: the PostgreSQL engine requires cgo. Please set CGO_ENABLED=1.
$ go env CGO_ENABLED
1
$ rm ~/go/bin/sqlc
$ go env -w CGO_ENABLED=1
$ go install github.com/sqlc-dev/sqlc/cmd/sqlc@latest
github.com/sqlc-dev/sqlc/cmd/sqlc
/usr/bin/ld: warning: x86_64.o: missing .note.GNU-stack section implies executable stack
/usr/bin/ld: NOTE: This behaviour is deprecated and will be removed in a future version of the linker
$ sqlc generate
$ go env CGO_ENABLED
1
I also installed couple of libraries like build-essential and libc-dev before I recreated the issue not sure if it made a difference.

I encountered this issue on WSL and ChromeOS linux environment.
the issue occurred when CGO_ENABLED was 0 when I installed sqlc and turning it on afterwards didn't help.
I was able to reproduce it here are some logs:

$ go env -w CGO_ENABLED=0
$ go env CGO_ENABLED
0
$ go install github.com/sqlc-dev/sqlc/cmd/sqlc@latest
$ go env -w CGO_ENABLED=1
$ sqlc generate
# package database
sql/schema/001_users.sql:1:1: the PostgreSQL engine requires cgo. Please set CGO_ENABLED=1.
sql/schema/002_users_apiKeys.sql:1:1: the PostgreSQL engine requires cgo. Please set CGO_ENABLED=1.
$ go env CGO_ENABLED
1
$ rm ~/go/bin/sqlc
$ go env -w CGO_ENABLED=1
$ go install github.com/sqlc-dev/sqlc/cmd/sqlc@latest
# github.com/sqlc-dev/sqlc/cmd/sqlc
/usr/bin/ld: warning: x86_64.o: missing .note.GNU-stack section implies executable stack
/usr/bin/ld: NOTE: This behaviour is deprecated and will be removed in a future version of the linker
$ sqlc generate
$ go env CGO_ENABLED
1

I also installed couple of libraries like build-essential and libc-dev before I recreated the issue not sure if it made a difference.

 I uninstalled the original one and installed it using brew and it was no problem.


regalloc2 upgrade being pulled in somehow with older versions of wasmtime crate

Did a cargo update today with no other changes.  wasmtime crate is v15.  No other bytecodealliance crates.  Build failed on cranelift vscode because something is pulling in a newer version of regalloc2.  Is something in wasmtime just pulling in the most recent of something? Just guessing.

cc @cfallin  and @elliottt, could y'all yank 0.9.4 of regalloc2 and republish it as 0.10.0? Locally I see:
$ cargo install<EMAIL_ADDRESS>...
error[E0599]: no function or associated item named `forward` found for struct `InstRange` in the current scope
    --> /home/alex/.cargo/registry/src/index.crates.io-6f17d22bba15001f/cranelift-codegen-0.102.1/src/machinst/vcode.rs:1340:20
     |
1340 |         InstRange::forward(start, end)
     |                    ^^^^^^^ function or associated item not found in `InstRange`
     |
note: if you're trying to build a new `InstRange`, consider using `InstRange::new` which returns `InstRange`
    --> /home/alex/.cargo/registry/src/index.crates.io-6f17d22bba15001f/regalloc2-0.9.4/src/index.rs:148:5
     |
148  |     pub fn new(from: Inst, to: Inst) -> Self {
     |     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
...

and it looks like this method was removed in 0.9.4

Will do, sorry about the trouble!

I've yanked 0.9.4, and will release 0.10.0 on Tuesday. I'll update wasmtime at the same time :+1:

With https://github.com/bytecodealliance/wasmtime/pull/9193 I'm going to consider this fixed (thanks @elliottt!) and the 0.10.0 upgrade will likely happen today but can be tracked independently of this.


Homekit Secure Video (HSV) setting not remembered

Describe the bug
When switching on 'Homekit Secure Video' and save using save button lower right, and restarting camera.ui (using homebridge OR settings -> system -> restart in camera.ui interface) the setting is not remembered and is OFF again.
To Reproduce
Swith on 'Homekit Secure Video' save the setting and restart camera.ui.
Expected behavior
The setting should be still on after restarting camera.ui
Logs
Screenshots

Environment

Node.js Version: v16.13.2
Homebridge Version: v1.4.0 (HAP v0.10.0)
Camera UI Version: v5.0.16-latest
Operating System: Debian 10 with Docker Alpine Linux (3.12.9)
Browser Version: Edge 97.0.1072.76 (Official build) (64-bit) on Windows 11

bump

fixed in v5.0.17-beta.3


Network requirements incorrectly list *.www.balena.io

https://www.balena.io/docs/reference/OS/network/2.x/#network-requirements
The network requirements documentation state that you should whitelist *.www.balena.io domains, but this should be *.balena-cloud.com I believe.
 Front conversations

Also present here https://www.balena.io/docs/faq/troubleshooting/faq/#what-network-ports-are-required-


Update AutomatedScienceSampler-1.3.5-KSP1.8.ckan

Correct for updated version 1.3.5-KSP1.8 of AutomatedScienceSampler and KerboKatzUtilities 1.5.2-KSP1.8.

This PR wouldn't work because the bot would overwrite it with the upstream source data, which is owned by the author, fix submitted in KerboKatz/Netkan#11.


Fix draft value not displaying in datepicker

Details
Introduced here https://github.com/Expensify/App/pull/6234. Updated BaseExpensiTextInput to use this.value instead of this.props.value.
Fixed Issues
$ https://github.com/Expensify/App/issues/6521
Tests

Log into NewDot.
Create a Workspace and click on Connect bank account
Click on Connect manually and enter 011401533 for routing number and<PHONE_NUMBER>331111 for account number. Click Save and continue
In the Company step enter random values and click Save & continue.
Go back and verify that the previously entered date is saved.

QA Steps
Steps above.
Tested On

[X] Web
[X] Mobile Web
[X] Desktop
[ ] iOS
[ ] Android

Screenshots

Web
https://user-images.githubusercontent.com/22219519/143964608-49d4464e-5d31-420b-a55c-3682361badf7.mov
Mobile Web
https://user-images.githubusercontent.com/22219519/143964719-cd54e9e5-d638-418a-aee6-736cffda0eae.mov
Desktop
https://user-images.githubusercontent.com/22219519/143964617-77a19720-f616-4b2d-82fb-415d8e2fad04.mov
iOS

Android

:hand: This PR was not deployed to staging yet because QA is ongoing. It will be automatically deployed to staging after the next production release.

🚀 Deployed to staging by @sketchydroide in version: 1.1.17-8 🚀

platform
result

🤖 android 🤖
success ✅

🖥 desktop 🖥
success ✅

🍎 iOS 🍎
success ✅

🕸 web 🕸
success ✅

🚀 Deployed to production by @roryabraham in version: 1.1.18-3 🚀

platform
result

🤖 android 🤖
success ✅

🖥 desktop 🖥
success ✅

🍎 iOS 🍎
success ✅

🕸 web 🕸
success ✅


Navbar fixed with better hover effects #431

Issue-#431
Navbar has been fixed with better hover effects from previous one
@arghadipmanna101

Can you merge it for GSSoc'24 @arghadipmanna101


Waystation Cargo Shuttle docking

It's too tight to both the doors, the solars room on the right is one tile too big to make both doors of the shuttle fit

My quick fix mid-round

Also this map is missing a the Emergency docking port

Can it still fit at least one dock? This is kind of a non-issue if it fits at least one dock, because ideally there will be per-map cargo and evac shuttles with auto-pilot.

The docking airlocks are also reversed on the cargo side. not sure if this is new but figured ill post it here since this issue is related to waystation cargo shuttle docking.

irrelevant


Removal of docker tests and related helper code

What type of PR is this?
/kind code-refactoring
What does does this PR do / why we need it:
see $SUBJECT
Which issue(s) this PR fixes:
relates to #4500
PR acceptance criteria:

[ ] Unit test

[ ] Integration test

[ ] Documentation

[X] I have read the test guidelines

How to test changes / Special notes to the reviewer:
All tests should pass

/lgtm


Different margin properties for top, left, etc

Hello, the original phantomjs documentation describes the margin property as "can be provided as a single dimension or as an object containing one or more of the following properties: 'top', 'left', 'bottom', 'right' ...".
Single dimension settings are working fine for me with php-phantomjs, but I cant find a way to use different settings for 'top' and 'left' using an object or array as margin setting. Will this be supported in the future?
In addition to this: Do you plan to support the repeating page header and footer properties of phantomjs?
Thank you in advance
Stephan

Support for single dimension margins will be in the next version which is about a week away. Will look into header/footer properties.

This has now been released in Version 4

@jonnnnyw Thanks for this great package, I was delighted to be able to get PDF generation setup quite quickly and with minimal confusion.
Has there been any progress on providing a unified approach for repeating page header/footer for PDFs? I read through the custom scripts documentation but wasn't entirely sure how I should structure things to implement repeating header/footer manually - whether I need to override the procedure_pdf.partial or generate a full custom template.
Thanks!

Hi @alexleonard
I have had someone else ask for the same thing so I will add it to the list. Would you mind creating a new issue for it so I can keep you updated and I will hopefully get to it next week.

Hey @jonnnnyw Sorry for the delay, created that issue now.


Lock acquisition hangs with kubedock 0.14.0

After upgrading kubedock from 0.13.0 to 0.14.0 we're experiencing problems with the lease acquisition when using the --lock flag. The startup hangs after the following log message:
leaderelection.go: attempting to acquire leader lease esta-tekton-dev/kubedock-lock...

and the testcontainers fail because the Docker API is not available.
This seems like a comeback of #40. The Lease resource is again left with a non-empty holderIdentity field after kubedock terminates.
We're running Kubedock on Openshift and the environment didn't change. Downgrading to 0.13.0 solves the problem thus it must be related to a change in 0.14.0.

This seems like a comeback of https://github.com/joyrex2001/kubedock/issues/40. The Lease resource is again left with a non-empty holderIdentity field after kubedock terminates.

Starting fails with timeout acquiring lock right, and you do see exit signal recieved, removing pods, configmaps and services when kubedock stops?
It looks indeed like #40 is back.

In #40 I did not found the root-cause, but re-organizing and rewriting the exit handler worked around it. Moving towards go 1.21 re-introduced the bug.
The root-cause is that the main go-routine is killed before the exit handler was finished, which would crash the exit handler. Making the main go-routine wait indefinitely and moving the exit responsibility to the exit handler (which was the initial imlementation/idea), makes sure all cancelations (including the release lock) are executed.

Released https://github.com/joyrex2001/kubedock/releases/tag/0.14.1 with this fix.

Thanks for the fast fix! I can confirm that the problem is resolved with 0.14.1.


getting 404

I downloaded the theme and uploaded to the GitHub page. and after going to that page I am getting a site not found.

Fixed!


ACD "Only one auth mechanism allowed" errors

What is your rclone version (eg output from rclone -V)

v1.36-209-gb44d0ea0

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Windows Server 2016

Which cloud storage system are you using? (eg Google Drive)

acd, Google drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone copy acd: gd:

A log from the command with the -vv flag (eg output from rclone -vv copy /tmp remote:tmp)

Using the proxy method from https://forum.rclone.org/t/proxy-for-amazon-cloud-drive/2848/52
-vv shows:
DEBUG : pacer: low level retry 2/10 (error HTTP code 400: "400 Bad Request": response body: "<?xml version=\"1.0\" encoding=\"UTF-8\"?>\n<Error>InvalidArgument<Message>Only one auth mechanism allowed; only the X-Amz-Algorithm query parameter, Signature query string parameter or the Authorization header should be specified</Message><ArgumentName>Authorization</ArgumentName><ArgumentValue>Bearer Atza|...</ArgumentValue><RequestId>...</RequestId><HostId>...</HostId></Error>")
And no transfer occurs.

I have the same error! I'm using the latest beta and Ubuntu 64-bit, mounting acd it works for some time then it became unresponsive. But if I try rclone lsd acd:/ it shows me the root folder!! Thanks and I hope that you can help us

I thought I'd fixed that issue... I think it is caused by transferring big files greater than the temp link threshold.
I wonder it is was reintroduced by go 1.8 which changed something in that area.
So what size are the files that give the error?

It seems to be related to filesize indeed. I tested a 2GB file and it worked, while a 5 GB file gave me the error mentioned before.

In my case actually after sometimes the mount option stop working, but looking at the log I got the same error as OP! Please help me

I have an idea what is happening here - can you try using --acd-templink-threshold 0 and see if that works around the problem?
What I think is happening is that files above a certain size are being redirected - but rclone is supplying the Authorization header on redirect.  I fixed this problem for the templink case already so the above might be a work around.  If it does work around the problem I know how to fix it properly.

Nice! --acd-templink-threshold 0 fixed it.

OMG thank you! You just saved me days of work!

I'm going to re-open this as I need to fix it properly!

having the same problem, copying files from acd to gdrive, version: rclone v1.38 linux/amd64 .. --acd-templink-threshold 0 workaround seems to have helped

I've now fixed this here
https://beta.rclone.org/v1.38-186-g6448c445/

Encountered this problem with the stable version too; it's working in practice and returning:

DEBUG : Removing Authorization: header after redirect to S3

I'm guessing that's all good?

@valentine yes that is working now. Thanks for testing.


Added git hook to check & test

I have fallen foul of checkstyle for the last time!
I've added a pre-commit githook which should fail commits if they do not pass the gradle check & test tasks.
Also added a gradle task to set up the git hook and some documentation on how and why to run it.

Au contraire, blackadder: https://github.com/LMAX-Exchange/disruptor/pull/322

If only this had been merged I could have had those hooks on the intermittency branch :(


Types

This PR refactors the type system: Types are kept separate from type inference, identifiers were changed, and documentation was added. The big addition is that variables have Strings as identifiers and variable types implement Display using that. As these types are variable, we cannot use the optimisation of storing formatted strings in the struct. Instead, we create a large string and replace occurrences of powers of two using relatively few allocations. This formatting can be used in a later PR to create helpful type errors.

@apoelstra I managed to get a SIGSEGV for fuzz target rtt_program_witness, which does type checking. (All our unit tests run fine.) It must be the RefCells. I suspect that my rewriting of find_root() or my compression of finalize() included an error that led to this. Could you take a look?

Yes, it is a stack overflow. You either need to put depth limits on things or (better) get rid of all the recursive algorithms.

I'm going to go ahead and ACK this (once my local scripts finish). In general we need to deal with recursion throughout the library. For things like stringification we ought to be caching this data (and perhaps computing it in constructors, which would let us avoid search-and-replacing complete strings to compactify type names).


Add 'HtmlListItem' support

This should be solved by #37 . Will close this after merge is completed.


Add warning when conducting a warping analysis for unconnected sections

Is your feature request related to a problem? Please describe.
A warping_analysis is not valid for geometries with unconnected sections. Currently a warping analysis can be performed, but it will return junk results without any warning to the user. Currently the only warning is in the documentation.
Describe the solution you'd like
A warning similar to the overlapping region warning for the plastic analysis.
Describe alternatives you've considered
Warning in documentation, however not everyone reads the whole documentation!
Additional context
@connorferster I feel like there should be a relatively simple way to check for unconnected regions usely Shapely but am utterly useless when it comes to that library so wondering if you have any quick ideas?

@connorferster sorry for the @'s 😆


->get()->with()

If I want 1 record with the relations, I think I should be able to do a ->get()->with()
but it throws me an error:
Call to undefined method Entities\Post::with() in ...\Mappers\Post.php
This means  I have to load the relations myself and inject them into the result?
Seems weird to me.

The with() method is used for eager loading to solve N+1 problem and probably only works with collections. There is no advantages to use  with() when retrieving only one entity.  You can access relations with their name. If you have something like:
class User extends \Spot\Entity
{
    ...
    public static function relations(Mapper $mapper, Entity $entity)
    {
        return [
            "profile" => $mapper->hasOne($entity, "Profile", "user_id")
        ];
    }
}

You can then access profile with:
$user =  $spot->mapper("User")->get(1);
print_r($user->profile);

I have a client entity with relations like this:
'country' => $mapper->belongsTo($entity, 'Entities\Country', 'country_id')
so I expect, when I do a client->get(), I must be able to use those relations too.
But I made another solution, so it works for me now.

Please read @tuupola's comment. You can access the relations with a simple -> operator. If you get() one entity, you don't need to use the with() function. with() is for collections.
$client->country

@marcelloh please post meaningful code examples with bug reports. Currently it is hard to tell what you are actually doing.

Ok, thanks. I think I didn't understand the documentation about belongsto quite well then.
I would say: a user belongs to a country, that why I choose the belongsto.
But I can say: a user has 1 country, so a hasOne is more in place.
though I still don't understand the difference yet, won't be able to tell my kids about it :-)
I will follow your lead: if it is a 1 on 1 : use hasOne!
Thanks again.

Thanks @tuupola and @FlipEverything for answering so quickly! You are both spot on (pun intended). The with method is designed for collections to solve the N+1 query problem, and doesn't provide any advantage when only a single record is involved.
You could still technically use it with a single record by creating a Spot\Query object:
$mapper->where(['id', 1])->with('country')->first();

But like I said, that doesn't really provide any benefit because the same number of queries are executed as:
$user = $mapper->get(1);
$user->country;

The only difference is that the relation query is executed when you access the country property, so it's lazy-loaded instead of eager-loaded via with.


🐛 [BUG] - make search button work

Description
Currently, the "icon-button" is not working.

Since it's a button, I'd expect to have the search start when I click on it
Reproduction URL
https://xray.helius.xyz/?network=mainnet
Logs
No response
Browsers
Chrome
OS
Linux

Resolved with PR #255


errors on loading the extension. also no 4k option.

on loading the extension in chrome, it shows some error, and although the subtitle customization is there, the 4k streaming option in video quality is not present.

Please mention which movie/series your are trying. JioCinema has different urls for different content and I'm still trying to find all urls.


where is the code to draw the value heatmap?

Hi, thanks for the great repo, again!
May I ask where is the code to draw the value heatmap?
Thanks!

We did not provide the code to draw the heatmap, as it needs some tricks and manual work to visualize the heatmap. The heatmap is a state-action-value (or say Q value) map, but our approach using PPO works only relying on the state value. To draw the heatmap, we can estimate the Q value by r(s_t, a_t, s_{t+1}) + gamma*V(s_{t+1}) given the state s_t, action a_t and the state at next time step s_{t+1}. So, we need to enumerate a_t manually using discretized values across all the action space.

wondering why we need s_{t+1} for r?

s_{t+1} is unnecessary if the computation of reward does not need information from s_{t+1}.
In our approach, we need s_{t+1} to decide if the agent reaches the goal or collide after taking the action a_{t}.

so is it something like
foreach agent:
   apply(a_t, s_t)

foreach agent:
   calculate_reward(s_{t+1})

reward is to evaluate how good/bad it is to take an action at a given state. So, the general form of reward computation is a function involving the current (given) state, the action, and the resulting state. That is r(s_t, a_t, s_{t+1}).
Of course, the computation of reward is completely dependent on how you define it. That is to say, in practice, you can use anything, which may or may not include s_t, a_t and s_{t+1}, to compute the reward.


BAH-3056 | Enable rules visibility in medication

Jira Link: https://bahmni.atlassian.net/browse/BAH-3077, https://bahmni.atlassian.net/browse/BAH-3056

@SooryaKumaranC-tw @Arjun-Go Closing this PR as the configuration changes included here will not be shipped by default in our product demo configuration. We will provide documentation on these configurations, allowing implementers to add them if needed
cc: @angshu @binduak


Skale implementation

Skale implementation

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.You have signed the CLA already but the status is still pending? Let us recheck it.

Hi @AzizBardi
This commit seems to have way too much change, only truffle.js and subgraph should have changed, like this PR :https://github.com/humanprotocol/hmt-escrow/pull/354/

Hello@foufrix
Truffle.js package.js and docker files were changed to make the project work.
These changes were necessary to make the project work.

You've pushed a change with 104 files changes, where there is only 2 needed, you need to clean this PR or it will be rejected.


Composite#call should take a variable number of arguments

Take this example:
# example.rb

require "dry/transformer"

module F
  extend Dry::Transformer::Registry

  def self.constantly(n)
    n
  end

  def self.square(n)
    n ** 2
  end
end

def F(*args)
  F[*args]
end

f = F(:constantly, 5) >> F(:square)
f.call

❯ ruby example.rb
Traceback (most recent call last):
	1: from example.rb:20:in `<main>'
/Users/me/.rbenv/versions/2.7.1/lib/ruby/gems/2.7.0/gems/dry-transformer-0.1.1/lib/dry/transformer/composite.rb:32:in `call': wrong number of arguments (given 0, expected 1) (ArgumentError)

Since all arguments have been applied, f.call should not require any arguments. However, Composite#call always requires one argument: https://github.com/dry-rb/dry-transformer/blob/master/lib/dry/transformer/composite.rb#L32 A simple fix would just to make Composite#call take a variable number of arguments, so that the first function in the chain can be called with as many arguments as it needs.

Do keep in mind *args is an extra allocation, so this potential fix would slow all other cases somewhat.


Change divide-by-zero to signal an error rather than return Nan

This is an instance of "Scheme hubris" is fell for when I implemented App Inventor arithmetic.   I wanted to "show off" and follow the Scheme convention of returning Nan, since this was part of the well-thought-out Scheme and Common Lisp arithmetic.   But it's the wrong thing for App Inventor

PR #818

#818 was closed


Update before.js

Removed the ".handlebars" extension in the scope.layout string on line 52.  Otherwise, the example app main view is broken from the start because the route is loaded as "layout.handlebars.handlebars".

Thank you @kbreed


How to manage multiple amplify projects with multiple company accounts on the same machine

Which Category is your question related to?
Hosting
Amplify CLI Version
4.41.1
What AWS Services are you utilizing?
S3, cloudfront, route 53, and etc
Provide additional details e.g. code snippets
I saw the use case, "host an Amplify app in multiple AWS accounts" in https://github.com/aws-amplify/amplify-cli/issues/2127.
But those multiple AWS accounts are under the same company. My question is different from that.
How can I manage multiple amplify projects with multiple "different" company accounts on the same machine?
Thanks.

@BlakeWu The CLI uses the profile to setup/modify an environment if you have the profiles setup per environment the CLI it should work out of the box.

@BlakeWu The CLI uses the profile to setup/modify an environment if you have the profiles setup per environment the CLI it should work out of the box.

@BlakeWu The CLI uses the profile to setup/modify an environment if you have the profiles setup per environment the CLI it should work out of the box.

Yeah. I know that. Just like #2127. Just not sure if it can work for different corporation accounts. If you say so, I will try it. Thanks!

@BlakeWu The CLI uses the profile to setup/modify an environment if you have the profiles setup per environment the CLI it should work out of the box.

Yeah. I know that. Just like #2127. Just not sure if it can work for different corporation accounts. If you say so, I will try it. Thanks!

Closing this issue. If you have any more questions, let us know and we can re-open


[Docs][Java] Update nightly docs to explain SNAPSHOT version

Describe the enhancement requested
I just discovered that the java nightly docs don't explain the SNAPSHOT version which is always the most recent build and can be used in projects to avoid having to manually update the version each day.
Component(s)
Documentation, Java

@assignUser hey, can I work on this issue? I am new to open source.

Welcome! Yes, please ahead! You can comment "take" to have the bot assign the issue too you.
You can check out the contribution guide for information on how we operate! https://arrow.apache.org/docs/dev/developers/contributing.html

take

@assignUser please tell me where I can get the information regarding the SNAPSHOT version.

https://nightlies.apache.org/arrow/java is where we keep the nightlies in maven like repo
You can check the java nightly job in .github/workflows for the details of how we upload the files and rename them.


Add File Previews

Add ability to preview files (pdfs, images, etc.), where possible

Added in e0abff


Python: Include stderr in provisioning error when log_output is set

Fixes #3838
The error was only captured if log_output wasn’t set. For the common use case of setting it to sys.stderr though, it’s not really lost, but always reading in a thread and writing to multiple places ensures the exception message always has it.
Signed-off-by: Helder Correia

The log is getting truncated at the end. We need to read the rest of the pipe before it gets closed.


Don't Merge! PR real time test for webhook case

Docs Build status updates of commit c06268f:
:clock10: Pending: waiting for processors (21 builds ahead of you)
:warning: Docs Build is busy, currently there are 21 builds ahead of this one, for more information you can view the Build queue graph on the Docs Portal.

Docs Build status updates of commit c06268f:
:clock10: Full build: the average full build time is 7 min(s) 25 sec(s), this is based on the last 30 build(s) for this repository.

Docs Build status updates of commit c06268f:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

docs-ref-conceptual/testing.md
:white_check_mark:Succeeded
View (azure-cli-latest) View (azure-cli-2017-03-09-profile) View (azure-cli-2018-03-01-hybrid)

For more details, please refer to the build report.
Note: Broken links written as relative paths are included in the above build report. For broken links written as absolute paths or external URLs, see the broken link report.
For any questions, please:Try searching in the Docs contributor and Admin GuideSee the frequently asked questionsPost your question in the Docs support channel


fix: set type info in package.json

Resolves #118.
Sets the type information to module in order to
enable usage of the import syntax.

Problem was not the type information but an old image version. In that version the Dockerfile referenced a non-existing file within its entrypoint.


Add gzip, bzip2, xz wordlist readers

Add support for enumerating over .gz, .bz2, xz, and maybe even .zip wordlists. Use the zcat, bzcat, xzcat commands to read each line from the wordlist; as they are technically faster than doing it in Ruby and does not add additional dependencies.

Added in d9b7088adbd2b14378b7978cf50ce23bd1dd0017, a0cd1687089ee8681bafbae48043965f98c980ef, a22c4e3302e9ff95e679fc9c2212d1f2250c47e3, respectively.


Fix some plural and puzzle strings, and remove other unused ones

This will fix some plural messages to be plural aware, puzzle strings to not be puzzle, and remove unused strings.
Tests: Not tested, based on logic.
Fixes #2085
Signed-off-by: Safa AlFulaij<EMAIL_ADDRESS>

Alright, the errors now are that some Format strings are not valid, and I don't really know what this means, sorry.
Others are about strings being different in the translated values files (whether the string is new or changed). This is supposed to be updated correctly by Weblate, right?

Also "Tests: Not tested, based on logic." is a bit scary no? ;)

“BUILD SUCCESSFUL in 3m 28s” :sob:
Yes, “Tests: Not tested, based on logic.” is scary, but that is what you get when a translator works as a developer of a language he doesn't even fully understand :p
Anyway the auto test confirms that things are fine now :)
About the time strings change, maybe it's a bit too much, but I think it's better to give full control to the translator.
I'm pretty sure builtins in Android have something ready for this, not sure where…

@bmarty PING! :p
Please inform me about any other concerns.

I've returned them but changed the tabs into spaces (I thought it's my browser/GitHub doing this). Not sure why weblate will do that for these strings only as other strings are using normal spaces…

Ok, thanks, I've merged the PR

What do you mean? Can you figured out a resource Id in arabic that is problematic?
Thanks


solana-0.35.1 can not be installed with solders 0.23.0

After
pip install solders
pip install solana

solders version is 0.21.0 which is an old version.

Fixed #459


Refactor packaging

This is just the two commits that refactor the package structure of toil-scripts from #73. @hannes-ucsc suggested that we split these out into a separate PR that can merge quickly, as to not block development, which I agree with. I am still working to address the following two comments that @hannes-ucsc made on #73:

User scripts (or rather user modules) must be invoked with python -m followed by a fully-qualified module path, e.g. ...

Some of the module and package names are a bit long, maybe we can remove the _pipeline from the end of module or package names. We could also adopt the convention of always naming user modules toil.py or main.py. The above example would then become ...

@jvivian, are you ok with this? It will break your wrapper scripts!

@hannes-ucsc The fix will be changing python <script>.py to python -m <script>.py in the wrappers, correct?  This will cause a bunch of merge conflicts for me, but I don't mind dealing it.  Better to just treat it like a band-aid and merge now.

@jvivian Not quite, the current directory needs to be src, the -m arg needs to be a fully qualified module path, not a relative script file path. See https://github.com/BD2KGenomics/toil-scripts/pull/73#issuecomment-169592209 for details.

@jvivian Instead of changing cwd to src, you can also make sure that the absolute path to src is in PYTHONPATH. I think I'll just go ahead and fix the wrapper scripts. In a continuation PR.

@hannes-ucsc if you want to open a PR against my fork/branch with the module path changes, then we can get this all in a single PR.

Continued in #77.


Announce ec2 removal version

I'd like to see the backwards compatibility of the EBS driver using "ec2" as the driver name removed for REX-Ray 1.0. The docs have long called it out as deprecated, so I think it's fair to say when we are going to remove it.
This will allow us to remove some code and simplify testing scenarios.
Discussed with @akutz, and he is on board.
Would like to hear thoughts from @cduchesne and @clintonskitson as well.

Codecov Report

Merging #532 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #532   +/-   ##
=======================================
  Coverage   28.53%   28.53%
=======================================
  Files          34       34
  Lines        1994     1994
=======================================
  Hits          569      569
  Misses       1364     1364
  Partials       61       61

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 44a5d1c...aac007d. Read the comment docs.

Codecov Report

Merging #532 into master will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #532   +/-   ##
=======================================
  Coverage   28.53%   28.53%
=======================================
  Files          34       34
  Lines        1994     1994
=======================================
  Hits          569      569
  Misses       1364     1364
  Partials       61       61

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 44a5d1c...aac007d. Read the comment docs.

+1


Add optional returnPartialData argument.

TODO:

[x] Update CHANGELOG.md with your change
[x] Make sure all of the significant new logic is covered by tests
[x] Rebase your changes on master so that they can be merged easily
[x] Make sure all tests and linter rules pass

Adds optional returnPartialData argument to readQueryFromStore and readFragmentFromStore.
While implementing updates from a CouchDB _changes feed, I found that I sometimes had information from the feed that wasn't yet in the store. While I could use readSelectionSetFromStore and pass returnPartialData: true, it seems that having the option to returnPartialData from both readQueryFromStore and readFragmentFromStore would be useful.

Ah, I think there is a merge conflict with your previous PR, can you update this one? Then I can merge it.

Sure. Coming in a moment. :-)

@stubailo Rebased on master.

Released in 0.3.20!


Add missing standard library include

Process.hpp references std::unique_ptr which is defined in <memory>.
<memory> was missing while <mutex> was included twice. Maybe a bad merge?

Thank you!


Add support to Remove-PnPSiteCollectionAppCatalog to remove app catalog by Site Id

Type

[x] Bug Fix
[ ] New Feature
[ ] Sample

Related Issues?
No related issues
What is in this Pull Request ?
Add support to Remove-PnPSiteCollectionAppCatalog to remove app catalog by Site Id by calling SiteCollectionAppCatalogsSites.RemoveById(guid) instead of Remove(url). This is needed when a site with an app catalog has the Url renamed or gets deleted.
Prefer RemoveById(guid) method when passing
New behavior with deleted site, the app catalog can be deleted:

Old behavior with deleted site, an error is thrown:

Old behavior with site deleted and recreated, the app catalog is not deleted:

Thanks @jackpoz, merged it !
Awesome find, thanks for sharing this 😊🙏


not work at all

Describe the bug
This simple plugin does not work at all
import fastifyIp from "fastify-ip";
app.register(fastifyIp);

app.get("/ip", async (req, reply) => {
  return { ip: req.ip };
});

console log print
{"ip":""}

Any suggestion?

Can you provide an
Minimum Reproducible Example?
A quick guess its that the ip of your request might not be populated from the request itself, not from within the plugin.


Hub mode doesn't work: can't get everyone to hear each other in proper channels

Weird stuff in hub mode:

Default behavior: Host can hear the other folks, but they are in left channel, and they cannot hear each other.
Running with -p2 (patch mode 2: 2=clients can hear all clients except themselves), host cannot hear anything, but the others can hear each other.

When I check things out manually, I'm seeing the while running hub, there's no way to route my audio to jacktrip. When I run p2p, I see the jacktrip:send_1, etc channels from jack_lsp
I tried running a jacktrip client on the same machine to connect to myself <IP_ADDRESS>, it connects, but on the other side they report static/distortion sounds (not audio)
I'm thinking I'm missing something with how hub works.

Some log snippets from the hub
`jackdmp 1.9.11
Copyright 2001-2005 Paul Davis and others.
Copyright 2004-2016 Grame.
jackdmp comes with ABSOLUTELY NO WARRANTY
This is free software, and you are welcome to redistribute it
under certain conditions; see the file COPYING for details
JACK server starting in realtime mode with priority 10
self-connect-mode is "Don't restrict self connect requests"
Input channel = 0 ==> JACK input port = 0
Input channel = 1 ==> JACK input port = 1
Input channel = 2 ==> JACK input port = 2
Input channel = 3 ==> JACK input port = 3
Input channel = 4 ==> JACK input port = 4
Input channel = 5 ==> JACK input port = 5
Input channel = 6 ==> JACK input port = 6
Input channel = 7 ==> JACK input port = 7
Input channel = 8 ==> JACK input port = 8
Input channel = 9 ==> JACK input port = 9
Input channel = 10 ==> JACK input port = 10
Input channel = 11 ==> JACK input port = 11
Input channel = 12 ==> JACK input port = 12
Input channel = 13 ==> JACK input port = 13
Input channel = 14 ==> JACK input port = 14
Input channel = 15 ==> JACK input port = 15
JACK output port = 0 ==> output channel = 0
JACK output port = 1 ==> output channel = 1
CoreAudio driver is running...
mThreadPool default maxThreadCount = 24
mThreadPool maxThreadCount set to 384
JackTrip HUB SERVER: UDP Base Port set to 61002
JackTrip HUB SERVER: TCP Server Listening in Port = 4464
JackTrip HUB SERVER: Waiting for client connections...
JackTrip HUB SERVER: Hub auto audio patch setting = 0
JackTrip HUB SERVER: Client Connection Received!
JackTrip HUB SERVER: Client Connect Received from Address : ::ffff:<IP_ADDRESS>
JackTrip HUB SERVER: Reading UDP port from Client...
JackTrip HUB SERVER: Client UDP Port is = 4464
JackTrip HUB SERVER: Sending Final UDP Port to Client: 61002
JackTrip HUB SERVER: Client TCP Connection Closed!
JackTrip HUB SERVER: Spawning JackTripWorker...
JackTrip HUB SERVER: Starting JackTripWorker...
--->JackTripWorker: PeerNumChannels = 2
mPeerAddress "::ffff:<IP_ADDRESS>" false
Setting JACK Process Callback...
SUCCESS
The Sampling Rate is: 44100
The Audio Buffer Size is: 256 samples
or: 1024 bytes
The Number of Channels is: 2
The RTAudio device ID is: 0
Using UDP Protocol
UDP Socket Receiving in Port: 61002
Waiting for Peer...
JackTrip HUB SERVER: Total Running Threads:  1
Received Connection from Peer!
spawning jacktripWorker so change patch
JackTrip HUB SERVER: Waiting for client connections...
JackTrip HUB SERVER: Hub auto audio patch setting = 0
UDP waiting too long (more than 30ms) for <IP_ADDRESS>...
JackTrip HUB SERVER: Client Connection Received!
JackTrip HUB SERVER: Client Connect Received from Address : ::ffff:<IP_ADDRESS>
JackTrip HUB SERVER: Reading UDP port from Client...
JackTrip HUB SERVER: Client UDP Port is = 4464
JackTrip HUB SERVER: Removing JackTripWorker from pool...
Stopping JackTrip...
JackTrip HUB SERVER: Removing JackTripWorker from pool...
JackTrip HUB SERVER: Removing JackTripWorker from pool...
JackTrip Processes STOPPED!
JackTrip ID = 0 released from the THREAD POOL
JackTrip HUB SERVER: Sending Final UDP Port to Client: 61002
JackTrip HUB SERVER: Client TCP Connection Closed!
JackTrip HUB SERVER: Spawning JackTripWorker...
JackTrip HUB SERVER: Starting JackTripWorker...
--->JackTripWorker: PeerNumChannels = 2
mPeerAddress "::ffff:<IP_ADDRESS>" false
Setting JACK Process Callback...
SUCCESS
The Sampling Rate is: 44100
The Audio Buffer Size is: 256 samples
or: 1024 bytes
The Number of Channels is: 2
The RTAudio device ID is: 0
Using UDP Protocol
UDP Socket Receiving in Port: 61002
Waiting for Peer...
JackTrip HUB SERVER: Total Running Threads:  1
Received Connection from Peer!
spawning jacktripWorker so change patch
JackTrip HUB SERVER: Waiting for client connections...
JackTrip HUB SERVER: Hub auto audio patch setting = 0
UDP waiting too long (more than 30ms) for <IP_ADDRESS>...
UDP waiting too long (more than 30ms) for <IP_ADDRESS>...
UDP waiting too long (more than 30ms) for <IP_ADDRESS>...
JackTrip HUB SERVER: Client Connection Received!
JackTrip HUB SERVER: Client Connect Received from Address : ::ffff:<IP_ADDRESS>
JackTrip HUB SERVER: Reading UDP port from Client...
JackTrip HUB SERVER: Client UDP Port is = 4464
JackTrip HUB SERVER: Removing JackTripWorker from pool...
Stopping JackTrip...
JackTrip HUB SERVER: Removing JackTripWorker from pool...
JackTrip HUB SERVER: Removing JackTripWorker from pool...
JackTrip Processes STOPPED!
JackTrip ID = 0 released from the THREAD POOL
JackTrip HUB SERVER: Sending Final UDP Port to Client: 61002
JackTrip HUB SERVER: Client TCP Connection Closed!
JackTrip HUB SERVER: Spawning JackTripWorker...
JackTrip HUB SERVER: Starting JackTripWorker...
--->JackTripWorker: PeerNumChannels = 2
mPeerAddress "::ffff:<IP_ADDRESS>" false
Setting JACK Process Callback...
SUCCESS
The Sampling Rate is: 44100
The Audio Buffer Size is: 256 samples
or: 1024 bytes
The Number of Channels is: 2
The RTAudio device ID is: 0
Using UDP Protocol
UDP Socket Receiving in Port: 61002
Waiting for Peer...
JackTrip HUB SERVER: Total Running Threads:  1
Received Connection from Peer!
spawning jacktripWorker so change patch
JackTrip HUB SERVER: Waiting for client connections...
JackTrip HUB SERVER: Hub auto audio patch setting = 0
UDP waiting too long (more than 30ms) for <IP_ADDRESS>...
JackTrip HUB SERVER: Client Connection Received!
JackTrip HUB SERVER: Client Connect Received from Address : ::ffff:<IP_ADDRESS>
JackTrip HUB SERVER: Reading UDP port from Client...
JackTrip HUB SERVER: Client UDP Port is = 4464
JackTrip HUB SERVER: Removing JackTripWorker from pool...
Stopping JackTrip...
JackTrip HUB SERVER: Removing JackTripWorker from pool...
JackTrip HUB SERVER: Removing JackTripWorker from pool...
JackTrip Processes STOPPED!
JackTrip ID = 0 released from the THREAD POOL
JackTrip HUB SERVER: Sending Final UDP Port to Client: 61002
JackTrip HUB SERVER: Client TCP Connection Closed!
JackTrip HUB SERVER: Spawning JackTripWorker...
JackTrip HUB SERVER: Starting JackTripWorker...
--->JackTripWorker: PeerNumChannels = 2
Setting JACK Process Callback...
SUCCESS
The Sampling Rate is: 44100
The Audio Buffer Size is: 256 samples
or: 1024 bytes
The Number of Channels is: 2
The RTAudio device ID is: 0
Using UDP Protocol
mPeerAddress "::ffff:<IP_ADDRESS>" false
UDP Socket Receiving in Port: 61002
Waiting for Peer...
JackTrip HUB SERVER: Total Running Threads:  1
Received Connection from Peer!
spawning jacktripWorker so change patch
JackTrip HUB SERVER: Waiting for client connections...
JackTrip HUB SERVER: Hub auto audio patch setting = 0
UDP waiting too long (more than 30ms) for <IP_ADDRESS>...
UDP waiting too long (more than 30ms) for <IP_ADDRESS>...
JackTrip HUB SERVER: Client Connection Received!
JackTrip HUB SERVER: Client Connect Received from Address : ::ffff:<IP_ADDRESS>
JackTrip HUB SERVER: Reading UDP port from Client...
JackTrip HUB SERVER: Client UDP Port is = 4464
JackTrip HUB SERVER: Removing JackTripWorker from pool...
Stopping JackTrip...
JackTrip HUB SERVER: Removing JackTripWorker from pool...
JackTrip HUB SERVER: Removing JackTripWorker from pool...
JackTrip Processes STOPPED!
JackTrip ID = 0 released from the THREAD POOL
JackTrip HUB SERVER: Sending Final UDP Port to Client: 61002
JackTrip HUB SERVER: Client TCP Connection Closed!
JackTrip HUB SERVER: Spawning JackTripWorker...
JackTrip HUB SERVER: Starting JackTripWorker...
--->JackTripWorker: PeerNumChannels = 2
Setting JACK Process Callback...
SUCCESS
The Sampling Rate is: 44100
The Audio Buffer Size is: 256 samples
or: 1024 bytes
The Number of Channels is: 2
The RTAudio device ID is: 0
Using UDP Protocol
mPeerAddress "::ffff:<IP_ADDRESS>" false
UDP Socket Receiving in Port: 61002
Waiting for Peer...
JackTrip HUB SERVER: Total Running Threads:  1
Received Connection from Peer!
spawning jacktripWorker so change patch
JackTrip HUB SERVER: Waiting for client connections...
JackTrip HUB SERVER: Hub auto audio patch setting = 0
UDP waiting too long (more than 30ms) for <IP_ADDRESS>...
JackTrip HUB SERVER: Client Connection Received!
JackTrip HUB SERVER: Client Connect Received from Address : ::ffff:<IP_ADDRESS>
JackTrip HUB SERVER: Reading UDP port from Client...
JackTrip HUB SERVER: Client UDP Port is = 4464
JackTrip HUB SERVER: Removing JackTripWorker from pool...
Stopping JackTrip...
JackTrip HUB SERVER: Removing JackTripWorker from pool...
JackTrip HUB SERVER: Removing JackTripWorker from pool...
JackTrip Processes STOPPED!
JackTrip ID = 0 released from the THREAD POOL
JackTrip HUB SERVER: Sending Final UDP Port to Client: 61002
JackTrip HUB SERVER: Client TCP Connection Closed!
JackTrip HUB SERVER: Spawning JackTripWorker...
JackTrip HUB SERVER: Starting JackTripWorker...
--->JackTripWorker: PeerNumChannels = 2
Setting JACK Process Callback...
SUCCESS
The Sampling Rate is: 44100
The Audio Buffer Size is: 256 samples
or: 1024 bytes
The Number of Channels is: 2
The RTAudio device ID is: 55116618
Using UDP Protocol
mPeerAddress "::ffff:<IP_ADDRESS>" false
UDP Socket Receiving in Port: 61002
Waiting for Peer...
JackTrip HUB SERVER: Total Running Threads:  1
Received Connection from Peer!
spawning jacktripWorker so change patch
JackTrip HUB SERVER: Waiting for client connections...
JackTrip HUB SERVER: Hub auto audio patch setting = 0
UDP waiting too long (more than 30ms) for <IP_ADDRESS>...
JackTrip HUB SERVER: Client Connection Received!
JackTrip HUB SERVER: Client Connect Received from Address : ::ffff:<IP_ADDRESS>
JackTrip HUB SERVER: Reading UDP port from Client...
JackTrip HUB SERVER: Client UDP Port is = 4464
JackTrip HUB SERVER: Sending Final UDP Port to Client: 61003
JackTrip HUB SERVER: Client TCP Connection Closed!
JackTrip HUB SERVER: Spawning JackTripWorker...
JackTrip HUB SERVER: Starting JackTripWorker...
--->JackTripWorker: PeerNumChannels = 2
Setting JACK Process Callback...
SUCCESS
The Sampling Rate is: 44100
The Audio Buffer Size is: 256 samples
or: 1024 bytes
The Number of Channels is: 2
The RTAudio device ID is: 0
Using UDP Protocol
mPeerAddress "::ffff:<IP_ADDRESS>" false
UDP Socket Receiving in Port: 61003
Waiting for Peer...
JackTrip HUB SERVER: Total Running Threads:  2
Received Connection from Peer!
spawning jacktripWorker so change patch
JackTrip HUB SERVER: Waiting for client connections...
JackTrip HUB SERVER: Hub auto audio patch setting = 0
UDP waiting too long (more than 30ms) for <IP_ADDRESS>...
`

As it turns out one must manually connect the channels, they show up AFTER the clients connect. Once one person connects, I get the full list. Although with some odd version of their IP:
system:capture_1
system:capture_2
system:playback_1
system:playback_2
..ffff.<IP_ADDRESS>:send_1
..ffff.<IP_ADDRESS>:send_2
..ffff.<IP_ADDRESS>:receive_1
..ffff.<IP_ADDRESS>:receive_2
I'll have to scrape out all those send_ / receive_ channels and auto-patch the server's I/O to them as they arrive. Fun


Add dark theme

This adds a dark theme via CSS' @media queries.

Thanks a lot! Sorry about the delayed merge :)


Structure reading sources

[x] Structure reading sources into a mini lit review spreadsheet

also started on miro boards for gap analysis and 'structured' discovery


v1.7.4 planning

Will release v1.7.4 / v2.0.0-beta.1 after merging and cherry-picking:

https://github.com/containerd/nerdctl/pull/2819

cc @containerd/nerdctl-maintainers

https://github.com/containerd/nerdctl/releases/tag/v1.7.4


ADDITIONAL_DEPS environment variable has stopped working with ASP.NET Core 2.1

Description
My project is injecting an external library as a dependency for the CoreCLR profiler. It uses ADDITIONAL_DEPS environment variable to achieve that. Everything works well as long as ASP.NET Core 2.0 web application is profiled, but if I use exactly the same workflow with ASP.NET Core 2.1 my library is not found by the application.
Diagnostics
This is what I have already tried:

profiling .NET Core 2.0 application - OK
profiling ASP.NET Core 2.0 application - OK
profiling .NET Core 2.1 application - OK
profiling ASP.NET Core 2.1 application using ADDITIONAL_DEPS env var - FAILURE
profiling ASP.NET Core 2.1 application using --additional-deps switch - FAILURE

In each of these cases, I was using the same deps.json file and dependent library.
I have found out using procmon.exe that in case of ASP.NET Core 2.1 dotnet.exe behaves differently than in other cases. Dependent assembly is NOT looked up in a location provided in *.deps.json file, but only in the profiled application directory.
Output from dottest.exe is as follows:
An assembly specified in the application dependencies manifest (hooks.deps.json) was not found:
    package: 'hooks', version: '<IP_ADDRESS>'
    path: 'C:/Program Files/Profiler/bin/hooks.dll'

I have double-checked assembly exists in this location.
And this is my *.deps.json file:
{
"runtimeTarget": {
    "name": "hooks"
  },
  "targets": {
    "hooks": {
      "hooks/<IP_ADDRESS>": {
        "runtime": {
          "C:\\Program Files\\Profiler\\bin\\hooks.dll": {}
        }
      }
    }
  },
  "libraries": {
    "hooks/<IP_ADDRESS>": {
      "type": "reference",
      "serviceable": false,
      "sha512": ""
    }
  }
}

Questions
1. How can I use additional-deps with ASP.NET Core 2.1 properly?
2. Is there some other way to inject external assembly to ASP.NET Core application?
3. Is there at least a workaround for this issue?

@pranavkm / @pakrym - any thoughts on this?

What the full path of deps.json file?
What is ADDITIONAL_DEPS set to?

Environment variable:
set DOTNET_ADDITIONAL_DEPS=c:\Users\MyUser\Documents\MyCompany\MyProduct\Profiler\hooks.deps.json
Physical path:
C:\Users\MyUser\Documents\MyCompany\MyProduct\Profiler\hooks.deps.json
My web application is hosted from a folder:
c:\inetpub\wwwroot\HW
and the only lookup for hooks assembly (based on procmon.exe output) is:
c:\inetpub\wwwroot\HW\hooks.dll
I will try to create a minimal repro for this issue.

Ok, I have managed to create a repro.
First, here is my dotnet --info output:
C:\Program Files (x86)\Microsoft Visual Studio 14.0>dotnet --info
.NET Core SDK (reflecting any global.json):
 Version:   2.1.401
 Commit:    91b1c13032

Runtime Environment:
 OS Name:     Windows
 OS Version:  6.1.7601
 OS Platform: Windows
 RID:         win7-x64
 Base Path:   C:\Program Files\dotnet\sdk\2.1.401\

Host (useful for support):
  Version: 2.1.3
  Commit:  124038c13e

.NET Core SDKs installed:
  2.1.401 [C:\Program Files\dotnet\sdk]

.NET Core runtimes installed:
  Microsoft.AspNetCore.All 2.1.2 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.All]
  Microsoft.AspNetCore.All 2.1.3 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.All]
  Microsoft.AspNetCore.App 2.1.2 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
  Microsoft.AspNetCore.App 2.1.3 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
  Microsoft.NETCore.App 2.1.2 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
  Microsoft.NETCore.App 2.1.3 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]

Instructions for using repro
ASP.NET_Core_Repro.zip

Zip contains compiled binaries, so first please trust the zip file by:
--- right click, select Properties from context menu
--- check Unblock option and click OK
Extract contents of zip file into C:\Temp
In C:\Temp\ASP.NET_Core_Repro there will be two batch files
--- running ASP_20_hooks should be successful
--- running ASP_21_hooks will fail with a message that hooks assembly cannot be found

Update
While I was trying to prepare a repro it turned out that I was able to use ADDITIONAL_DEPS environment variable successfully when running:
dotnet.exe [AppSrcDir]\bin\Debug\netcoreapp2.1\MyApp.dll
but after running Publish from Visual Studio and running:
dotnet.exe [AppDeployDir]\MyApp.dll
ADDITIONAL_DEPS stopped working as expected.
Can you tell me what is the reason behind that?
Is it a bug or is it expected?
How to inject my assembly into deployed application then?

Is there any chance I will get some help from ASP.NET Core team regarding this issue?

Is the app you are publishing portable or standalone?

I am not sure if this is the desired information. If it is not, then please tell me how can I check this.

/cc @swaroop-sridhar/@vitek-karas

Another update
I was struggling to prepare a repro because the similar thing happened also while I was trying to prepare an example for ASP.NET Core 2.0. I could not use ADDITIONAL_DEPS with my ASP.NET Core 2.0 application because there was the same issue as in case of ASP.NET Core 2.1.
It turns out that target version of ASP.NET Core for a web application is not related to this error, it is the installed runtime that causes this issue.
Repro
I have prepared a very simple repro based on some example found on GitHub. The zipped example contains also debug binaries. It was built against ASP.NET Core 2.0.
Also, the second package contains my sample assembly and its *.deps.json file to be used as a value for ADDITIONAL_DEPS environment variable.
How to reproduce:
In each case, ADDITIONAL_DEPS should point to hooks.deps.json.
Case 1: Having installed runtime and hosting for ASP.NET Core 2.0 (no 2.1 components installed). The attached example will work perfectly fine with dotnet.exe running hello-world-no-startup.dll assembly directly from the build folder. Also, after publishing it to IIS Server and running it from deployment folder it will work as expected without any errors.
Case 2: After installing runtime and hosting for ASP.NET Core 2.1 example will work properly with dotnet.exe running hello-world-no-startup.dll assembly directly from the build folder. After deploying the application to IIS Server, there will be an error preventing the application from starting, saying that hooks.dll defined in hooks.deps.json cannot be found.
Please let me know if you will need any help from my side.

Is there any progress regarding this issue. Can I provide any additional data to help to solve it?

Hi @tobyash86, I couldn't repro the failure on asp.net core 2.1. I was able to run the test on ASP.net2.1 on build and publish directories. I also tried publishing to IIS using webdeploy. Can you please paste the exact commands you tried, and the error?
There's no reference to hooks.dll from the program. I didn't see an error even after setting the ADDITIONAL_DEPS in the environment.
Do you have the probing paths configured correctly?

Hi @swaroop-sridhar,
I will try to revalidate my repro on several different machines to eliminate an impact from my environment.
Also, I will do the checks which you have suggested and let you know.

There's no reference to hooks.dll from the program. I didn't see an error even after setting the ADDITIONAL_DEPS in the environment.

No reference to hooks.dll is expected, as my scenario requires to inject that dll into any website dynamically.
Thanks for your engagement!

You can also try to set COREHOST_TRACE=1 environment variable alongside your ADDITIONAL_DEPS. The process should then write detailed information about probing into the stderr which I assume ASP.NET somehow captures.

Sorry for 2 weeks delay, but I was busy with other topics.
Just a quick update: I have run the scenario on other machine and it worked properly. For now, the only difference I see is that machine 1 is Windows 7 machine, and the working one is Windows 10 machine.
For some reason on the Windows 10 machine, ADDITIONAL_DEPS environment variable is resolved properly and my hooks assembly is loaded by the CLR profiler. On Windows 7 machine lookup is done only in the website folder (after copying my assembly to that folder everything works as expected).
@swaroop-sridhar wrote:

Do you have the probing paths configured correctly?

I doubt if this has anything to do with probing paths as the json file passed in ADDITIONAL_DEPS environment variable contains a full path to hooks assembly.
Tomorrow I will perform a more detailed comparison between the two machines and let you know about my findings.

Maybe this is dotnet related, not asp.net core? I found following https://github.com/dotnet/core-setup/blob/dbb1c1e55eab169f4af370e9a61b85a982ff1105/Documentation/design-docs/additional-deps.md which references https://github.com/dotnet/core-setup/issues/3889 which says:

Starting with netcore 2.1 runtime the logic to find deps files has changed.

The issue seems to be focused on additional deps pointing to a folder, but maybe there was a change (intended or not) which also affects the file case?

Was the provided repro successful on your side?

Hi @tobyash86, I haven't tried the new repro instructions yet; I'm working on another issue, and will get to it shortly. Thanks.

Maybe this is dotnet related, not asp.net core?

I have checked and the same problem happens with normal .net core console application which is published.

When it's published with Deployment Mode "Framework Dependent" and Target Runtime "Portable", you can workaround it by putting hooks.dll in the Target Location
When it's published with Deployment Mode "Self-contained" and Target Runtime "win-x86", the workaround does not work

Since this is a dotnet core issue, let's mode the discussion to the appropriate repo here: https://github.com/dotnet/core-setup/issues/4811
Thanks.

I will try to prepare repro this week or early next week.

Closing.

I have found out that using DOTNET_ADDITIONAL_DEPS requires also specifying additionalprobingpath parameter. Using both of them works well.
There is another problem though... Can I specify additionalprobingpath as an environment varable? My goal is to set it dynamically for ASP.NET Core application.

@tobyash86 additionalprobingpaths can be set in the runtimeconfig.json file or the command line parameter. But there is no option to set it as an environment variable.
additionalprobingpaths is processed at host startup time.

I think that DOTNET_ADDITIONAL_DEPS is working similarly, but can be specified as an environment variable. I will post a feature request for that.

Also, I think this issue cannot be closed, because --additional-deps behaves differently for .NET Core than for ASP.NET Core.
I have prepared a series of batch files running .NET Core processes with different settings. Please check my repro.
On my machine ASP_HelloWorldWithDeps_FAIL.bat behaves differently than CON_SampleAppWithDeps_OK - please note that both of them does not have --additionalprobingpath specified.
I have Runtime 2.2.4 and SDK 2.2.203 installed. I had to uninstall any other SDK/runtime versions to reproduce this issue. Please refer to README.txt in repro package for more details.

@tobyash86 ASP.NET Core has no impact on how ADDITIONAL_DEPS is handled, it's handled entirely by the dotnet host. https://github.com/dotnet/core-setup is a more appropriate repo for bugs/feature requests there so they are visible to the team that develops that component. https://github.com/dotnet/core-setup/issues/4811 appears to be covering some of this.
Closing as this is not in an ASP.NET Core component.


Modified to save predicted objects every 2 seconds to be used as training data

Please see here https://github.com/zubairahmed-ai/yolov3

Do you mean to save every 2 second of JPEGImage and get annotation file of voc format automatically？

Nope. Just all identified objects as images every two seconds. It is not perfect yet and has its flaws that I'm working on

Now it works fine, it also doesn't repeatedly saves stationary objects (like parked car) and tries not to even draw border around it

Good luck


Investigate website dark mode on mobile

Dark mode on mobile is hard to read (gray on black) while other parts are very bright

Thanks @AlecAivazis for finding this!