Document Process to Create/Update Pairwise Testing Data & Recreate gdb/project

We don't seem to have the full set of steps/tools needed to go from the
(1) JMSML source data:
https://github.com/Esri/joint-military-symbology-xml
to (2) Pairwise Inputs
https://github.com/Esri/military-features-data/tree/master/data/mil2525d/utilities/pairwise-testing
to (3) Pairwise Outputs GDB
https://github.com/Esri/military-features-data/blob/master/data/mil2525d/sample_data/gdbs/PairwiseTestData.gdb.zip
Example - how were the points/lines/areas generated. How do we create/update/synch this data from the JMSML source?
Update the readme/repo to include these here so we can repeatably re-create this data.
Tasks:

[ ] Create readme to document the process
[ ] Update PICT 3.3 source data used
[ ] Update PairwiseTestData.gdb
[ ] Update PairwiseTestProject.ppkx

Reassigning to @Dbarnes1 to work on - time permitting. @lfunkhouser can provide an overview/assistance if needed.

@csmoore I can work with @Dbarnes1 to help with this.  Basic steps were:

PICT 3.3 was used to get the pairwise sampling.
The Create Fishnet tool in ArcGIS was used to create the points.
Add Join tool in ArcGIS was used to join the PICT output to the points.
Append tool in ArcGIS was used to append the data to the Military Features schema

This was the workflow for points.  The Fishnet tool does not work well for lines and areas.

Thanks for the update, this only became an issue because we use this dataset so much for testing (it is a really great stress test) - but there are a few bad entity codes (perhaps because the JMSML data was incorrect or in flux when the source data was created).  But it looks like all @Dbarnes1 might need to do to fix this is update the entity line of the source data (ex: https://github.com/Esri/military-features-data/blob/master/data/mil2525d/utilities/pairwise-testing/pict/input/ControlMeasuresAreasPICT.txt#L2 )
An additional note, this readme does not need to be super-detailed since we don't anticipate doing this very often, updating the package to not have incorrect symbols is the priority.

@csmoore if put in a readme, will Archie's test dataset documentation cover this issue? if not I can create a readme file from this doc:
Steps to Join XLS Table to fishnet points.docx

@Dbarnes1 - this issue was specific to the pairwise (which Archie hasn't started working on) - but the pairwise and comprehensive test dataset creation workflow should be 60% similar and can be combined if possible/helpful.

@csmoore closing this issue. Pairwise test data has been documented, updated so that it is repeatable. https://github.com/Esri/military-features-data/tree/v.next/data/mil2525d/utilities/pairwise-testing


General Napalm improvements

This PR contains changes made in #37
Short description
This PR contains some improvements that may be helpful for some projects. I have made them, because I needed them myself and decided to try to upstream them. I have tried to keep backwards compatibility as much as I could. From my tests, buildPackage should work exactly the same as it worked before this PR (or better).
Issues that are related or fixed by this PR

#9 - Patching packages fixes pre-distributed binaries and custom patch mechanism allows to prefetch some binaries manually with Nix.
#16 - npmCommands is now a string that is directly inserted by default (it can still be a list for compatibility).
#17 - Fixed with nodejs argument to buildPackages.
#30 - Not checked, but may be fixed with patching packages as it sanitizes packages names.

Changes

Overriding npm - This is quite a simple mechanism that creates a script called npm and adds it to PATH before normal npm so that every time npm is called, we can patch shebangs or do basically anything. This script also calls real npm with proper arguments. It also exposes preNpmHook and postNpmHook that can be specified as arguments and are run respectively before and after every npm call. This approach allows controlling nested npm calls.
Patching fetched Npm packages - This mechanism can be enabled by patchPackages argument to the buildPackage. It is patching every  fetched package from npm with custom function called mkNpmTar which fixes some common npm issues (shebangs and binaries). It also exposes customPatchPackages argument to the buildPackage function that allows overriding everything that mkNpmTar is doing with a simple override-like mechanism (see example in my README.md).
Patching integrities of package-lock.json packages based on snapshot when npm packages were patched. This is done with new lock-patcher.mjs script. It is required as npm install checks integrity.
Improved flake.nix, basically everything that has been done in #37
Added possibility for project to have multiple package-lock.json, which can be specified by additionalPackageLocks argument.
pname, version and name now work as expected for every Nix derivation.
Support for custom node.js versions.
Added more information and improved README.md.

Thanks for the contribution but now it is even harder to review than the previous one.
For example, just the first commit:

Added development shell

Looks good.

Improved overlay for other flakes to use

As far as I can tell, it just makes the whole default.nix available instead of just the napalm helper functions? Why would we want to pollute the namespace in the overlay with stuff that is mostly just useful for testing napalm by CI?

Added packages that are part of default.nix to the packages field

Again, with the exception of napalm-registry, these are unrelated to napalm’s purpose and people should not use them.

Removed checks, as nix flake check automatically checks packages

Makes sense if we use the previous one.
Just having the four concerns in the single commit made it harder to review, making me unsure if the second part did anything other than what I noticed.

Sorry if the commits are confusing, I tried my best to split it up as well as I could. I have made a small rebase, with intention to make things more clear.

As far as I can tell, it just makes the whole default.nix available instead of just the napalm helper functions? Why would we want to pollute the namespace in the overlay with stuff that is mostly just useful for testing napalm by CI?
Again, with the exception of napalm-registry, these are unrelated to napalm’s purpose and people should not use them.

I put everything into overlay, because then I wanted to use it in packages field. I know that most people are not likely to use anything other than buildPackage, but I though that it doesn't really matter as Nix is lazy evaluated, and it is not likely to affect anything. If it bothers you, I can remove it from the overlay and move it into the checks field.

Also, can you run nixpkgs-fmt on all of it?

I did run it on flake.nix, although I am not sure about using it on default.nix as it wasn't used before on this file. I didn't want to change most of the file with formatting.
I have also made flake.nix use flake-utils as it makes it more compact in my opinion.

@gytis-ivaskevicius when you give me green light for the changes here I can merge it. I currently don't have the capacity to review it myself.

I have applied formatting and fixed ternary operator formatting.

Also, I don't think that you can overwrite nodejs version without overlays?

I am not sure what do you mean to be honest, but I will try to explain what do I mean by "custom node.js version". I have made it possible to pass custom NodeJS package like pkgs.nodejs-14_x to the buildPackage function and then whenever NodeJS may be used, this version is used. There is an example of that in the README.md (rendered reference). This way, you can also override some NodeJS major version and downgrade it to a specific minor version that you may need, there is an example of that in that README.

Did a couple of tweaks, from my point of view this is ready to be merged.
@Mazurel Are you fine with these last 3 commits? Do you think this PR is ready to be merged?

@gytis-ivaskevicius They look fine to me, the only thing that could be implemented are some tests for the new features, but I think they could be added in another PR (when nix flake check will work).

@Mic92 This PR is ready to merge :)


Feature request - Syncing books and status with Calibre

I'm not sure if this is possible, or even the correct place to ask, but I would love the ability to sync my books and read status with Calibre or Kobo. I use a plugin to copy my read status over to calibre when I sync my Kobo, and I'd like a way to sync that to my home instance of Jelu.
Not sure if it's possible or if there is a better place to ask for this, sorry if it's the wrong place or not possible.

If I understand correctly you use a calibre plugin to sync the read status from your kobo. So the easiest way that would match your flow would be a calibre plugin that syncs the progress to your jelu instance. I don't know if a jelu plugin exists in calibre, it should not be too complicated to create since calibre has all the infos needed.

That is correct. I have looked and there doesn't seem to be a calibre plugin for Jelu,
I'm not a programmer unfortunately, but it seems like a project to try to learn on.

Now that I've had a bit more coffee, I realize I'm thinking of this the wrong way. I didn't do any kind of import on my initial setup, so I was adding my owned books manually. I can use a plugin to export my library to goodreads, export that and import it to Jelu then just update my reading status once the book is read.
Sorry for the troubles.


saving file shows Error: Error: spawn EACCES

On every file save I see this error message. It is rather annoying.
I searched online but didn't find anything useful. Seems to be a node issue.
Edit: This is not an issue with VSCode, it is probably an issue with one of extensions, please try disabling each one and seeing if you get this error.

@thewhitetulip maybe something off with permissions. are you sure the user you are opening code with has rights to write to the files in question?

Yes, the user I am running has full rights on the path where the files are stored.

@thewhitetulip actually the error indicates an issue spawning a command, not writing to a file. Does it reproduce when you disable extensions by running "code --disableExtensions"? Can you attach the full error that is printed.

Hey, I ran it with code --disableExtensions then I am not seeing that error, but if I start with ./code then I see the error again.
Gtk-Message: Failed to load module "pantheon-filechooser-module"
Gtk-Message: Failed to load module "canberra-gtk-module"
bash: cannot set terminal process group (-1): Inappropriate ioctl for device
bash: no job control in this shell```
I don't see the spawn error printed on the commandline
`Error: Error: spawn EACCES`
![screenshot from 2016-01-19 23 04 43](https://cloud.githubusercontent.com/assets/6261877/12426702/0b82e350-bf01-11e5-96df-d420263c72a3.png)

@thewhitetulip this indicates one of your extensions is causing this error, can you find out which one and please report it to the extension writer.

Okay, how do I understand which extension is causing the error, as I said there is no command line error message

@thewhitetulip I think we need to do better error reporting in the future to help you. currently the only way forward is to manually remove extensions one by one until the issue is gone I fear.

:+1: Cool. At least some positive aspect for the editor :smile:

Hey I found a hack to make that annoying dialog box disappear
to the class global-message-list I add the following css property in the dev tools
display: none;

I had this error when I was trying to link to php program to the application.
While I was doing it I went and copy the path were the application resides... something happen and the VC turned off when I turned it back on (Before adding the application name to the path "php") I did not get the error message that php compiler could not be found but rather the "spawn EACCES" error.
I also noticed that php errors were not underlined.!!
When I went to check the php.validate.executablePath this was there...
// Points to the php executable.
    "php.validate.executablePath": "/opt/lampp/bin/"

I added the "php" to the end ... restarted it .. the the Spawn Eacces error was gone.
Not sure why that error came up instead of the php validate error that should pop up.

@agt313 thanks, it helped me too.

@aircokol Andrey, hello. I can't follow - where I should add "php to the end"?

@agt313 it seems to me I've got the same problem here. Also, it's like you've solved the problem by "adding php to the end", and I've tried to do so - can't understand where exactly I had to add "php" in settings files of my Visual Code.
I've locally installed php71 via Homebrew. Also, I do have MAMP Pro installed on my Mac El Capitan. It's like they are "competing" with each other. When I saved .php files on my Visual Code IDE (v1.9.1), there was an error with PHP installed version of 5.5.6 instead of required above 7.0, so I'm just stuck here.

@wallmarkets Hi. I fixed it like so (in MAMP case):
"php.validate.executablePath": "/Applications/MAMP/bin/php/php7.0.10/bin/php",
Earlier I didn't have php at the end of the PHP executable path.

Awesome guys! Thanks for sharing the solution! I also solved it (mamp case) by inserting php at the end of php.validate.executablePath value, I was missing that php at the ned,same as aircokol.
Thanks!

Thanks for this thread too!
I first tried the command line option code --disableExtensions to run VSCode without extensions to rule those out as the cause very quickly as I still had that error appear. So I didn't need to go one-by-one through them all.
The advice to check the  php.validate.executablePath setting was crucial for me as well. It was not present on my workspace settings so adding that resolved the nagging error.
If anyone else is using Acquia for Drupal Development, you can get the path to the php executables for your particular site through the Acqiua DevDesktop Preferences>Config>PHP panel, which shows the location of all the php.ini files for each version of PHP that your sites are using. Just remember to remove the '.ini file extension when you copy the path.
I'd recommend updating the php.validate.executablePath setting using the VSCode workspace.settings file instead of user.settings file so you can configure the correct PHP version for each site/workspace in case you have sites using older versions of PHP.


Why word embeddings learned from word2vec are linearly correlated

Hi @WesleyyC , I conducted some experiments myself, and see some funny result as described here,
https://stats.stackexchange.com/questions/337083/why-word-embeddings-learned-from-word2vec-are-linearly-correlated
I wonder if you have experienced similar results or have any comment in general?

I don't really have a good explanation, but have your tried different randomization method for your initialization？
Essentially the first position and the second position are encoding the same information (since points are linearly correlated). Therefore, the problem comes down to why the embedding just use one single position when it has two position. I suspect that's because in both cases they are genearting really bad result and the two position is initialized in a similar way (let's say all small values around 0) then the gradient might not help to differentiate the two positions.
In addition, to my knowledge, no one has tried to investigate how wod2vec works using highly compressed feature vector, so that might be something interesting to look at.


Remove implicit path=/ from HTTP::Cookie

The path property of an HTTP cookie has no fixed default value and omitting the attribute entirely has significantly different semantics from / (see RFC 6265 §<IP_ADDRESS>). Currently, omission is impossible because the HTTP::Cokie#path property is non-nilable (it was nilable prior to #1498 and the serialization code still checks for nil). Thus the parser incorrectly sets path= "/" if the value is omitted, which changes semantics.
This patch makes the path property nilable and removes the default value /.
We could consider keeping / as default in the constructor, if we want the match-all semantics by default. But I think sticking with the standard semantics for omitting the value is better.

@bcardiff seems that doc is outdate in https://crystal-lang.org/api/1.0.0/HTTP/Cookies.html#[]=(key,value:String)-instance-method

@waghanza Thanks for mentioning, should be fixed with https://github.com/crystal-lang/crystal/pull/10669


Handling of 204 return code

In case of an indoor activity, no GPS data is available. So GPX cannot be formated.

@Nerisson thanks for the PR, it is now merged


Does Envoy have basic HTTP authentication?

If you are reporting any crash or any potential security issue, do not
open an issue in this repo. Please report the issue via emailing
<EMAIL_ADDRESS>where the issue will be triaged appropriately.
Title: One line description
Does Envoy have basic HTTP authentication?  Maybe similar to NGINX's authentication: https://docs.nginx.com/nginx/admin-guide/security-controls/configuring-http-basic-authentication/
Description:

I'm looking for a credentials prompt before a user can access a webpage.

[optional Relevant Links:]

Any extra documentation required to understand the issue.

There's currently no built-in Basic Auth filter, but this could be accomplished either by:

using this Lua snippet (courtesy of @dio) from https://github.com/envoyproxy/envoy/issues/8175
using External Authorization to do a look-aside request to an auth service which implements basic auth

Otherwise I think it'd be a feature request

We can support BasicAuth after the credential injector http filter  is finished.


[ecto 2.0] Invalid expression for MongoDB adapter in select clause in query

I took a stab at making support for ecto 2.0
So far, what i did was:
git diff ../../lib/mongo_ecto.ex                                                                                ✱
diff --git a/lib/mongo_ecto.ex b/lib/mongo_ecto.ex
index eb9c299..927ad45 100644
--- a/lib/mongo_ecto.ex
+++ b/lib/mongo_ecto.ex
@@ -395,6 +395,14 @@ defmodule Mongo.Ecto do
   end

   @doc false
+  def child_spec(repo, opts) do
+    Supervisor.Spec.worker(__MODULE__, [repo,opts], [])
+  end
+
+  def dumpers(:binary_id, type), do: [type, Ecto.UUID]
+  def dumpers(_, type), do: [type]
+
+  @doc false
   def stop(pid, timeout) do
     ref = Process.monitor(pid)
     Process.exit(pid, :normal)
@@ -477,7 +485,7 @@ defmodule Mongo.Ecto do
   @read_queries [ReadQuery, CountQuery, AggregateQuery]

   @doc false
-  def execute(repo, _meta, {function, query}, params, preprocess, opts) do
+  def execute(repo, _meta, {_, {function, query}}, params, preprocess, opts) do
     case apply(NormalizedQuery, function, [query, params]) do
       %{__struct__: read} = query when read in @read_queries ->
         {rows, count} =

But, trying to run the simple example app, left me stuck at:
** (Ecto.QueryError) Invalid expression for MongoDB adapter in select clause in query:

from w in Weather,
  where: w.prcp > 0.0 or is_nil(w.prcp),
  select: w

    (mongodb_ecto) lib/mongo_ecto/normalized_query.ex:455: Mongo.Ecto.NormalizedQuery.error/2
    (mongodb_ecto) lib/mongo_ecto/normalized_query.ex:52: Mongo.Ecto.NormalizedQuery.all/2
    (mongodb_ecto) lib/mongo_ecto.ex:489: Mongo.Ecto.execute/6
            (ecto) lib/ecto/repo/queryable.ex:129: Ecto.Repo.Queryable.execute/5
            (ecto) lib/ecto/repo/queryable.ex:41: Ecto.Repo.Queryable.all/4

Inserting IEx.pry in NormalizedQuery.all/2, I'm getting:
iex(1)> Simple.sample_query
Request to pry #PID<0.264.0> at /Users/kristian/code/elixir/src/mongodb_ecto/lib/mongo_ecto/normalized_query.ex:51

        params = List.to_tuple(params)
        query  = query(original, params, from)
    IEx.pry
        case projection(original, params, from) do
          {:count, fields} ->

Allow? [Yn]

Interactive Elixir (1.2.3) - press Ctrl+C to exit (type h() ENTER for help)
pry(1)> from
{"weather", Weather, :id}
pry(2)> params
{}
pry(3)> query
%{"$or": [[prcp: ["$gt": 0.0]], [prcp: nil]]}
pry(4)>

For the fun of it, I tried debugging the sample app with ecto 1.0.
This gives me the exact same values in {from,params,query}, but runs fine.
Does anybody see what I am missing here?

Did a small debugging session with erlang dbg last night (special thanks goes to qhool/quaff).
I debugged side by side with ecto 1.0 and ecto 2.0.
It turns out, that when it hits:
defp projection(%Query{select: %Query.SelectExpr{fields: fields}} = query, params, from),
    do: projection(fields, params, from, query, %{}, [])

the value of 'fields' is different.
With ecto 1.0: {'&',[],[0]}
With ecto 2.0: [{'&',[],[0,[id,city,temp_lo,temp_hi,prcp,inserted_at,updated_at],7]}]
While Ecto 1.0 continues fine, this results in Ecto 2.0 ending up in
  defp projection([{op, _, _} | _rest], _params, _from, query, _pacc, _facc) when is_op(op) do
    error(query, "select clause")
  end

So I guess that explains the "Invalid expression" error message.
Has anybody got a clue to what may go wrong, and where to look to fix this?
One other thing that is nagging me, is that when running with Ecto 1.0, it calls:
def dump(type, data), do: Ecto.Type.dump(type, data, &dump/2)
So I wonder whether it has to do with my crude implementation of dumpers/2, but I can't see how that makes a difference to the value of 'fields'.
Any opinions on that?

Hello, I'm sorry it took me so long to get back to you.
Yes, it looks like Ecto 2.0 changed the format of the select field by adding all the fields inline. This is a rather good change for us, as we extract that data today ourselves here: https://github.com/michalmuskala/mongodb_ecto/blob/master/lib/mongo_ecto/normalized_query.ex#L150-L153
Dumpers probably does not affect that particular part, it will affect how we cast data types, but that is next step.

No sweat.
Anyway, your comment was enough for me to realise the little something that I'd been missing. Pattern matching. So I made another projection, like this:
defp projection([{:&, _, [0,fields,_]} = field | rest], params, {_, model, pk} = from, query, pacc, facc) do
    pacc = Enum.into(fields, pacc, &{field(&1, pk), true})
    facc = [field | facc]

    projection(rest, params, from, query, pacc, facc)
  end

Which seems to do the trick, but left me at:
** (UndefinedFunctionError) undefined function Simple.Repo.log/1
          (simple) Simple.Repo.log(%Ecto.LogEntry{connection_pid: nil, decode_time: nil, params: [], query: #Function<11.10125602/1 in :dbg_ieval.expr/3>, query_time: 963, queue_time: 39, result: {:ok, %Mongo.ReadResult{cursor_id: 0, docs: [%{"_id" => #BSON.ObjectId<570b6e781412e60d4ddcc42d>, "city" => "cph", "prcp" => 100.5, "temp_hi" => 35.0, "temp_lo" => 15.0}, %{"_id" => #BSON.ObjectId<570b6e801412e60d4ddcc42e>, "city" => "cph", "prcp" => 210.1, "temp_hi" => 35.0, "temp_lo" => 15.0}, %{"_id" => #BSON.ObjectId<570b6e8b1412e60d4ddcc42f>, "city" => "cph", "prcp" => 210.1, "temp_hi" => 18.0, "temp_lo" => 10.0}, %{"_id" => #BSON.ObjectId<570b6e981412e60d4ddcc430>, "city" => "cph", "temp_hi" => 18.0, "temp_lo" => 10.0}], from: 0, num: 4}}})
         (mongodb) lib/mongo/pool.ex:144: Mongo.Pool.run_with_log/5
         (mongodb) lib/mongo/cursor.ex:33: anonymous fn/6 in Enumerable.Mongo.Cursor.start_fun/6
          (elixir) lib/stream.ex:1084: anonymous fn/5 in Stream.resource/3
          (elixir) lib/enum.ex:1477: Enum.reduce/3
          (elixir) lib/enum.ex:1155: Enum.map_reduce/3
    (mongodb_ecto) Elixir.Mongo.Ecto.erl:508: Mongo.Ecto.execute/6

And I really don't get why. I would have thought Ecto.Repo implemented such log/1.
But I guess I'll find out after work.

Ecto 2.0 changed how logging is done. The log function is definitely gone, but I'm not sure what replaced it from the perspective of an adapter. You could try disabling logging for now (commenting out the logging code).

For logging the adapter needs to call repo.__log__/1 with Ecto.LogEntry as argument. The repo then needs to be configured with loggers: [{mod, fun, args}]. The mod, fun, args is called as apply(mod, fun, [%Ecto.LogEntry{} | args]) and must return Ecto.LogEntry to be used for the next logger.

Closing in favour of the PR: https://github.com/michalmuskala/mongodb_ecto/pull/84


Budget app wip

• removed checkForIndexedDb routine from db.js
• changed code on line 87 for empty field detection
• updated demo assets
• updated package json
• test read me markdown
• read me md wip
• added local AND heroku instructions
• more instructions
• specified fig 3 + 4 data comes from fig 1
• fixed mp4 url


ElasticViT camera-ready code

@1hunters please read the following Contributor License Agreement(CLA). If you agree with the CLA, please reply with the following information.
@microsoft-github-policy-service agree [company="{your company}"]

Options:

(default - no company specified) I have sole ownership of intellectual property rights to my Submissions and I am not making Submissions in the course of work for my employer.

@microsoft-github-policy-service agree

(when company given) I am making Submissions in the course of work for my employer (or my employer has intellectual property rights in my Submissions by contract or applicable law). I have permission from my employer to make Submissions and enter into this Agreement on behalf of my employer. By signing below, the defined term “You” includes me and my employer.

@microsoft-github-policy-service agree company="Microsoft"

Contributor License Agreement

@microsoft-github-policy-service agree [company="Tsinghua university"]

@1hunters the command you issued was incorrect. Please try again.
Examples are:
@microsoft-github-policy-service agree

and
@microsoft-github-policy-service agree company="your company"

@microsoft-github-policy-service agree company="Tsinghua university"


Revert "Update Status Badge to the new build system"

Reverts snapcrafters/fork-and-rename-me#28

why is this needed?


[WIP] Random selection op

This op selects N random values from each row of a sparse matrix, which starts to take us beyond the current capabilities of GraphBLAS a little bit.  (After we get more experience with random operations, I think we might propose random operations be added to GraphBLAS spec, given their importance to a variety of graph algorithms.)

Note that this PR hasn't incorporated the dropping of the builtin namespace from func again (see #149).  That will be fixed in this PR once we've updated our MLIR package and merged #149.

Next I need to bring in some more MLIR runtime (specifically memrefCopy()) and also need to write some external "choose N integers from [0, M)" functions to call.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

37 of 38 (97.37%)  changed or added relevant lines in 2 files are covered.
5 unchanged lines in 2 files lost coverage.
Overall coverage increased (+0.2%) to 82.104%

Changes Missing Coverage
Covered Lines
Changed/Added Lines
%

mlir_graphblas/ops.py
12
13
92.31%

Files with Coverage Reduction
New Missed Lines
%

mlir_graphblas/engine.py
1
74.8%

mlir_graphblas/tests/test_profile.py
4
51.95%

Totals

Change from base Build<PHONE_NUMBER>:
0.2%

Covered Lines:
2427

Relevant Lines:
2956

💛  - Coveralls

Going to merge this for now.  The intermittent pagerank crash seems to be unrelated, and is captured in #163.


[$250] mWeb - WS - In #admin room the message about the upgrader disappears

If you haven’t already, check out our contributing guidelines for onboarding and email<EMAIL_ADDRESS>to request to join our Slack channel!

Version Number: 9.0.62-2
Reproducible in staging?: Y
Reproducible in production?: Y
If this was caught during regression testing, add the test name, ID and link from TestRail: https://expensify.testrail.io/index.php?/tests/view/5223810
Issue reported by: Applause Internal Team
Action Performed:

Log in the app
Go to Settings and create a new WS
In the new WS go to More Features and enable Accounting
Tap on Netsuite/Sage
Tap upgrade button
Navigate to WS screen and Tap 3 dots
Go to #admins room

Expected Result:
User is navigated to the #admins room, the upgrade system messages have posted, including a message from Expensify mentioning the upgrader.
Actual Result:
The upgrader is mentioned in a separate whisper message, that is only displayed briefly. In the system message the upgrader is not mentioned.
Workaround:
Unknown
Platforms:

[ ] Android: Standalone
[ ] Android: HybridApp
[x] Android: mWeb Chrome
[ ] iOS: Standalone
[ ] iOS: HybridApp
[ ] iOS: mWeb Safari
[ ] MacOS: Chrome / Safari
[ ] MacOS: Desktop

Screenshots/Videos
https://github.com/user-attachments/assets/bd868c03-7ccb-47a5-aa30-01d70d99e7b6
https://github.com/user-attachments/assets/c8edf4a2-a6bb-49a8-b872-8126e14e73c3

View all open jobs on GitHub
Upwork Automation - Do Not Edit

Upwork Job URL: https://www.upwork.com/jobs/~021857185698447287009
Upwork Job ID:<PHONE_NUMBER>447287009
Last Price Increase: 2024-11-14

Issue OwnerCurrent Issue Owner: @Ollyws

Pulling out a few screenshots from the reproduction video so it's easier to see what's going on here. Here's the #admins room chat showing the upgrade system message:

And here's the same admins room seconds later, after the system message disappeared:

@Ollyws can you please confirm if this needs to be handled in BE? If so, I can change to internal.

We have a ton of POLICYCHANGELOG system messages and as far as I know, they're all created and stored API-side and the workspace changes require access to backend code. I'm going to mark internal for now, but if it turns out that @daledah's front-end solution will work, we can switch it back.

Ooh weird. Yeah I can take a look at this...

@yuwenmemon let me know if you think we need to change to weekly.

Looks like this is fully backend - I'll remove @Ollyws since it doesn't seem like we need a C+ review.

PR was deployed to prod last week. We're all done here!


Change member variable prefix in AttendanceActivity.java

Prefix all member variables in AttendanceActivity.java with this. and remove the m prefix.
For example,
mContext

becomes
this.context

File location: /app/src/main/java/app/abhijit/iter/AttendanceActivity.java
If this is your first pull request, read this article: (https://www.digitalocean.com/community/tutorials/how-to-create-a-pull-request-on-github). Make sure all test cases pass before submitting your pull request.
Happy Hacktoberfest! 🔥

Hii..can I work in this issue?

Yeah sure

Hi..how do i check if its passing all the test cases?

Right click on the test directory in Android Studio and click on Run...
Or, you can just execute gradlew test on the command line.
See: https://www.youtube.com/watch?v=dlWjn4QrVK4

Thnks @abhijitparida I'll send a pull request by tonight as I would need to install Android studio and Developer tools.

No problem.

hi...i am getting this error after running the gradle test on command line
Task :app:compileDebugJavaWithJavac
/home/redarcher9/Documents/op/bunk/bunk/app/src/main/java/app/abhijit/iter/AttendanceActivity.java:229: error: cannot find symbol
this.SharedPreferences.edit().putString("pref_student", null).apply();
^
symbol: variable SharedPreferences
/home/redarcher9/Documents/op/bunk/bunk/app/src/main/java/app/abhijit/iter/AttendanceActivity.java:397: error: cannot reference this before supertype constructor has been called
super(this.context, R.layout.item_subject, subjectViews);
^
/home/redarcher9/Documents/op/bunk/bunk/app/src/main/java/app/abhijit/iter/AttendanceActivity.java:397: error: cannot find symbol
super(this.context, R.layout.item_subject, subjectViews);
^
symbol: variable context
/home/redarcher9/Documents/op/bunk/bunk/app/src/main/java/app/abhijit/iter/AttendanceActivity.java:399: error: cannot find symbol
mLayoutInflater = LayoutInflater.from(this.context);
I think it has something to do with inheritance

Did you change the mSharedPreferences declaration to sharedPreferences? You have to refer to it as this.sharedPreferences.

Made some changes and now the build is successful..

I sent a PR. Please check it


Parametrize Nodes and add tree printing

This adds pretty printing from AbstractTrees and makes it possible to dispatch on nodes as they have distinct types now. Should we parametrize by the language as well? The tests break as they are currently dependent on the printing of the trees, but I wanted to get your thoughts first.

Hi @kskyten thanks for the PR. I'm happy with leveraging AbstractTrees for printing.
Could you outline the use case for parameterising on node type? I assume it's for allowing multiple dispatch on nodes, eg
f(n::Node{:for}) = ...
f(n::Node{:while}) = ...
# etc...

rather than hard coding conditional branches? It would be more ergonomic perhaps, though may (possibly) cause some type-instability issues due to all the nodes having differing types and the potential associated runtime hit during traversal. Probably best to leave language parameter out of the equation for now until we are decided on whether node type parameterisation is the right thing to do.
(As you can probably tell by the lack of activity in this repo I've not had much time recently to work on it, but I'm fine with discussing things/answering questions about things.)

Hi @kskyten thanks for the PR. I'm happy with leveraging AbstractTrees for printing.
Could you outline the use case for parameterising on node type? I assume it's for allowing multiple dispatch on nodes, eg
f(n::Node{:for}) = ...
f(n::Node{:while}) = ...
# etc...

rather than hard coding conditional branches? It would be more ergonomic perhaps, though may (possibly) cause some type-instability issues due to all the nodes having differing types and the potential associated runtime hit during traversal. Probably best to leave language parameter out of the equation for now until we are decided on whether node type parameterisation is the right thing to do.
(As you can probably tell by the lack of activity in this repo I've not had much time recently to work on it, but I'm fine with discussing things/answering questions about things.)

Yes, parametrising is for multiple dispatch. I find multiple dispatch is a very nice way of dealing with ASTs.Good point about the type-instability. I hadn't thought of the performance implications. I should see how it is done in https://github.com/julia-vscode/CSTParser.jl.

Yes, parametrising is for multiple dispatch. I find multiple dispatch is a very nice way of dealing with ASTs.Good point about the type-instability. I hadn't thought of the performance implications. I should see how it is done in https://github.com/julia-vscode/CSTParser.jl.

I hadn't thought of the performance implications. I should see how it is done in https://github.com/julia-vscode/CSTParser.jl.

I think CST used to use a EXPR{HEAD} implementation, or something similar. But from what's currently there it looks like there is no parameter now. Not 100% sure on its history though.

I hadn't thought of the performance implications. I should see how it is done in https://github.com/julia-vscode/CSTParser.jl.

I think CST used to use a EXPR{HEAD} implementation, or something similar. But from what's currently there it looks like there is no parameter now. Not 100% sure on its history though.

It can have a noticeable impact on runtime if you're iterating over a collection of parameterised nodes where each parameter isn't statically known, which will result in dynamic dispatch, though sometimes if the parameter set is small and known Julia does some union splitting for us. I doubt that would be the case with Symbol parameters, but the only way to actually know is some benchmarking.

It can have a noticeable impact on runtime if you're iterating over a collection of parameterised nodes where each parameter isn't statically known, which will result in dynamic dispatch, though sometimes if the parameter set is small and known Julia does some union splitting for us. I doubt that would be the case with Symbol parameters, but the only way to actually know is some benchmarking.

For what it's worth, the parser which is now the default in Julia, JuliaSyntax.jl, does not parameterize nodes for performance reasons
From the documentation about the Kind struct (emphasis added)

Kind is a type tag for specifying the type of tokens and interior nodes of a syntax tree. Abstractly, this tag is used to define our own sum types for syntax tree nodes. We do this explicitly outside the Julia type system because (a) Julia doesn't have sum types and (b) we want concrete data structures which are unityped from the Julia compiler's point of view, for efficiency.


[V9] This mod would still be useful to be after V9

I heard from the devs that you were considering whether or not you'd even continue this mod. Just know that the map that was the reason i got this module would still benefit from better lighting. The new vision still peeks through walls occasionally over long distances. Just my two cents

Thanks for the feedback. The final decision on whether to port Lichtgeschwindigkeit will be ported hasn't been made yet. Any feedback of users still feeling a need for this module help me make my final decision :)

@manuelVo this module has transformed what my players laptops could handle within FoundryVTT. I'd love to see this continued but however you choose, thanks for writing this module in the first place. 🦀

This might sound crazy, but I haven't played much tactical combat since v9 came out, so I have no first-hand experience of now the new vision system performs. What's certain at this point is that there will be no v9 support, since v10, which brings further changes to the vision system. So porting it at this point wouldn't be worth it.
In any case, even for v10 a port of Lichtgeschwindigkeit is unlikely. The major pain points I've had with the v7 vision system are now addressed and maintaining the module is a significant portion of work - especially with how quickly the lighting system in Foundryvtt is moving. I feel like the little benefit that would still remain from the Lichtgeschwindigkeit module is not worth the huge amount of work that's necessary to maintain it.

Hey I remembered this module and went to see if it ever did get updated. Just wanted to say thanks again very much for making it. It was a god send back when I used it


Shuffle rebuses to randomize the game a bit

This allows to shuffle the rebuses collection so that we don't get the same rebus order every time we refresh.
To maintain compatability with the current tests, the shuffle function was mocked to return the same collection.

Pull Request Test Coverage Report for Build 94

0 of 0   changed or added relevant lines in 0 files are covered.
1 unchanged line in 1 file lost coverage.
Overall coverage increased (+0.08%) to 89.313%

Files with Coverage Reduction
New Missed Lines
%

src/js/rebuses.js
1
75.0%

Totals

Change from base Build 88:
0.08%

Covered Lines:
88

Relevant Lines:
100

💛  - Coveralls

Awesome, this was on my todo-list 👍
Instead of doing the shuffle directly in the getRebuses function, lets just export the shuffle function and do shuffle(getRebuses()) here. That way we do not have to mock the shuffle function and we will always assign the same id to the rebuses (might be a good idea if we want to be able to share/load a specific rebus from a url in the future).

I mocked the shuffle function because I thought the snapshots were going to break (since we now provided the rebuses in a random order - which is not expected in the snapshots). Can you explain why we don't need to mock it if we put it in the store.js? 🙂
But I'll gladly do these changes. I initially was going to have a separate helpers.js file and import it - but thought that adding a new file just for this purpose was not worth it.
Thank you for your feedback 👍

Oh we will of course still have to provide a mock for the shuffle function in store.spec.js. You can just add shuffle: collection => collection to the existing mock here.
The main point why we don't want to shuffle the rebuses directly in the  getRebuses function is because we want to make sure that we always assign the same id to the rebuses if we want to be able to share/load a specific rebus from a url in the future.
For now I think you can just put the shuffle function in rebuses.js

Hey! Sorry for the delay. I applied the shuffle function on the initial store as you requested. I've also merged the latest changes on master.


hjs-dev-server error during npm start

I just installed based on instructions and got the following when running "npm start":
npm ERR! Linux 3.2.0-23-virtual
npm ERR! argv "/usr/bin/nodejs" "/usr/bin/npm" "start"
npm ERR! node v4.3.1
npm ERR! npm  v2.14.12
npm ERR! file sh
npm ERR! code ELIFECYCLE
npm ERR! errno ENOENT
npm ERR! syscall spawn
npm ERR<EMAIL_ADDRESS>start: hjs-dev-server
npm ERR! spawn ENOENT
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>start script 'hjs-dev-server'.
Installing "hjs-webpack" manually resolved the error.  The OS is Ubuntu 12 LTS.

You need npm@3 for all dependencies to be properly resolved. (https://github.com/ipfs/webui#development) Can you please test if it works fine that way?

I'm going to chalk this one up to my environment for the moment since it's reproducible @ npm v3+, but without consistency.  I'm going to roll a clean VM and try again.

On a clean Ubuntu 14 LTS with Node-v4.3.1 and Npm-v3.7.3...
Running "npm install" fails with this:
loadDep:sntp → attempt Killed
...unless I run it with sudo.
After running "sudo npm install", I then run "npm start" and get this:
_npm ERR! Linux 3.13.0-71-generic
npm ERR! argv "/usr/bin/nodejs" "/usr/bin/npm" "start"
npm ERR! node v4.3.1
npm ERR! npm  v3.7.3
npm ERR! file sh
npm ERR! code ELIFECYCLE
npm ERR! errno ENOENT
npm ERR! syscall spawn
npm ERR<EMAIL_ADDRESS>start: hjs-dev-server
npm ERR! spawn ENOENT
npm ERR!
npm ERR! Failed at the<EMAIL_ADDRESS>start script 'hjs-dev-server'.
_
If you need a video of the process I will provide one.  The image I used was the "node v4.3.0 on Ubuntu 14" single click image from Digital Ocean, then updated node and npm to the latest versions before doing the install.

Any resolution on this? I'm encountering the same issue in my recently provisioned DO droplet.


Set jackson BOM versions in jib-gradle-plugin

The jib-gradle-plugin release failed with the following:
org.gradle.api.tasks.TaskExecutionException: Execution failed for task ':jib-gradle-plugin:publishPlugins'.
	at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.lambda$executeIfValid$1(ExecuteActionsTaskExecuter.java:187)
...
Caused by: com.gradle.publish.MissingDependencyVersionException: No version found for com.fasterxml.jackson.core:jackson-databind on pom generation.
	at com.gradle.publish.PomWriter.addDependency(PomWriter.java:60)

My theory is that once we switched from hardcoded versions to a BOM, that jib-gradle-plugin no longer gets the jackson versions from its dependency in jib-core.

Closing in favor of #3625 .


Fix issue with constraint on generated col

Summary of the changes / Why this improves CrateDB
Previously, it was impossible to create a table with a constraint on a
generated column, or add a generated column with a constraint to an
existing table, i.e.:
CREATE TABLE test(
    col1 INT,
    col2 INT GENERATED ALWAYS AS col1*2 CHECK (col2 > 0)
)

or
CREATE TABLE test(col1 INT)

ALTER TABLE test ADD COLUMN col2 INT GENERATED ALWAYS AS col1*2 CHECK (col2 > 0)

Checklist

[x] Added an entry in CHANGES.txt for user facing changes
[x] Updated documentation & sql_features table for user facing changes
[x] Touched code is covered by tests
[x] CLA is signed
[x] This does not contain breaking changes, or if it does:

It is released within a major release
It is recorded in CHANGES.txt
It was marked as deprecated in an earlier release if possible
You've thought about the consequences and other components are adapted
(E.g. AdminUI)

@matriv I think our field resolver should better only resolve fields and not validate any (higher) business logic like it currently does.
So instead of creating more logic there, what about doing the other way around and create concrete validation for generated columns that their expression must not contain themself, similar to the existing  EnsureNoMatchPredicate.ensureNoMatchPredicate validation?
This would remove any special GeneratedReference logic while resolving.

My initial idea of adding a 2nd validation step maybe problematic related to performance and after checking more resolveField implementation, I saw that we do a lot of existing validating on resolving.
So a better idea to decouple resolving and validation may be to pass in some kind of validator interface into the FieldResolver, wdyt?

It looks like the last implementation still hits the IllegalArgumentException because there is another path to it through CreateIndexService. Just an FYI for the second approach.

It looks like the last implementation still hits the IllegalArgumentException because there is another path to it through CreateIndexService. Just an FYI for the second approach.

Sorry @jeeminso, I don't understand, where is this call/path that you're referring to?

Thx @jeeminso fixed and added integ test: https://github.com/crate/crate/pull/12865/commits/4bdf0c83c26dd347c497955813d232ca320b4bc0

@seut, I've been thinking, and I'm not sure how we can pass a generic iface (function I guess) to validate stuff in the resolveField(). In our case we iterate on tableReferences list which is specific to TableReferenceResolver, and for each reference we need to validate. How can we pass such a validator from several levels up, i.e. DocIndexMetadata, see: https://github.com/crate/crate/commit/4bdf0c83c26dd347c497955813d232ca320b4bc0

Would it be an option to remove the validation in:
https://github.com/crate/crate/blob/9ae6d123a635703c09206b036835b2fe5231c86d/server/src/main/java/io/crate/analyze/expressions/TableReferenceResolver.java#L58-L60
And instead add a second pass validation pass in the create/alter table analazyers?  That could be very concrete, a visitor that visits the references.

@seut Could you please check the updated version of the fix?

retest this please


entry.isIntersecting always returns true if observed element or parent has an opacity or transition style

Are you reporting a bug or requesting a feature?
Bug
What is happening?
If the observed element has CSS opacility rule (or its close parent) entry.isIntersection always be true even for below the fold elements (invisible or out of viewport). Considering this, my team have faced with issue when elements load immediately instead of being postponed.
What is the expected behaviour?
The elements which are not in viewport have not to be loaded.
Which version of LazyLoad are you using?
10.x
In which browser(s) and browser version(s) are you experiencing the problem?
The issue related to Chrome <=71. Here is issue in the Intersection API
and here is official issue in Chrome which was fixed and will available with new Chrome 72 release.
Until Chrome not released new version, I suggest you don't rely on entry.isIntersecting property at all and just check intersectionRatio > 0. Also IE doesn't support isIntersecting.
All is need to fix is to update 1 line in your code. After that all is works for me perfectly:
export const isIntersecting = entry =>
entry.isIntersecting || entry.intersectionRatio > 0;
I've created a PR https://github.com/verlok/lazyload/pull/294

@dverbovyi I don't remember what is the specific case, I would need to test it again on the most recent versions of MS Edge. Will do.

Fixed in version 11.0.2

I just found a case where entry.intersectionRatio = 0 while entry.isIntersecting = true. I'm not sure how to reproduce it, but it's on a large gallery of images and happens to every image on a particular row, causing that row to not load. The images are sized in percentages, so they have a fractional height (231.047px), in case that matters, but there are also a number of absolutely & relatively positioned elements (the layout is generated by a JS plugin) that may also contribute to it being 0.
I added this console.log:
  var isIntersecting = function isIntersecting(entry) {
    console.log(entry.intersectionRatio, entry.isIntersecting);
    return entry.intersectionRatio > 0;
  };

And got this output (note: there are 4 images per row):
// Initial page load:
0 false
1 true
0.7310053110122681 true
0.7324966788291931 true
0.7332969307899475 true
0.7310053110122681 true
0.730560302734375 true
0.7320507168769836 true
0.7328505516052246 true
0.730560302734375 true
0.7301152944564819 true
0.7316048741340637 true
0.7324041724205017 true
0.7301152944564819 true
0.08727166801691055 true
0.08744971454143524 true
0.08754526078701019 true
0.08727166801691055 true
296 times: 0 false
// On scroll:
4 times: 0.09810027480125427 true
4 times: 0.08227764815092087 true
4 times: 0.012658100575208664 true
4 times: 0.09810027480125427 true
4 times: 0.003164525143802166 true
4 times: 0.009493575431406498 true
4 times: 0.012658100575208664 true
4 times: 0.015822624787688255 true
12 times: 0.006329050287604332 true
4 times: 0 true
4 times: 0.003164525143802166 true

I'm not sure what's the best fix generally, but I have switched it to entry.isIntersecting || entry.intersectionRatio > 0 for now to make it work correctly (in Chrome 72 at least).

Thank you for your test @davejamesmiller
I guess now that Chrome 72 is out we can switch it back to isIntersecting || intersectionRatio > 0 as it was before.
I also noticed that in some cases the ratio was 0 while the Boolean was true.
That doesn’t make any sense to me, but I feel safer to use both values.

@davejamesmiller would you please do a pull request against my development branch?

@davejamesmiller don't bother, I'm on it.

Closed, again, with version 11.0.3.

Great, thanks!
On Mon, 4 Mar 2019, 7:44 am Andrea Verlicchi<EMAIL_ADDRESS>wrote:

@davejamesmiller https://github.com/davejamesmiller don't bother, I'm
on it.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/verlok/lazyload/issues/293#issuecomment-469150221,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAOcSKS9s-R5SOH1d8S8Y7RR7bd9YT7oks5vTM76gaJpZM4aIPki
.


Failed to start WireGuard via wg-quick(8) for wgcf.

EUserv VPS
CentOS 8
安装报错：Failed to start WireGuard via wg-quick(8) for wgcf.
请问一下如何解决呢？

systemd[1]<EMAIL_ADDRESS>Main process exited, code=exited, status=1/FAILURE
systemd[1]<EMAIL_ADDRESS>Failed with result 'exit-code'.

我也是，ipv4没问题，装ipv6时
WireGuard failure to run!
nft -f /dev/fd/63
/dev/fd/63:5:1-131: Error: Could not process rule: No such file or directory
/dev/fd/63:6:1-117: Error: Could not process rule: No such file or directory
resolvconf -d wgcf -f
Too few arguments.
Too few arguments.
ip -6 rule delete table 51820
ip -6 rule delete table main suppress_prefixlength 0
ip link delete dev wgcf
<EMAIL_ADDRESS>Main process exited, code=exited, status=1/FAILURE
Failed to start WireGuard via wg-quick(8) for wgcf.
<EMAIL_ADDRESS>Unit entered failed state.
<EMAIL_ADDRESS>Failed with result 'exit-code'.

EUserv VPS
CentOS 8
安装报错：Failed to start WireGuard via wg-quick(8) for wgcf.
请问一下如何解决呢？

EUserv 用 Debian 10 ，它家用的那个 LXC 瘸腿虚拟化用 CentOS 毛病挺多的。


Indentation as a heading.

⚠ Please check that this feature request hasn't been suggested before.

[X] I searched previous Ideas in Discussions didn't find any similar feature requests.
[X] I searched previous Issues didn't find any similar feature requests.

🔖 Feature description
It would be nice if repetitive tasks were grouped together under one indentation.
✔ Solution
I suggest using indentation as a heading for repetitive tasks. Here's an example.

And in the task filter, the heading should move to its place. Here's an example.

❓ Alternatives
No response
📝 Additional Context
No response

Thanks for the suggestion but from the pictures, I'm afraid I do not understand what the proposal is.
In particular, I cannot work out what the 'heading' text is in the 2 screenshots, that is, where it came from.
Please supply a more detailed example, showing some actual tasks, and what you would like them to look like in the two situations you have images for.
If you are showing a query, please show the text of the query as well as the image.
Thanks in advance.

Sorry you closed this. There’s a new feature in Tasks coming out soon that might have this possible, if we knew what this request was exactly for.
If you wanted to explain more, I would be happy to reopen and see what I can suggest.

Excuse me, but I don't have a sufficient command of English, so I can't articulate my thoughts properly

Excuse me, but I don't have a sufficient command of English, so I can't articulate my thoughts properly

I understand. Could you draw pictures instead, perhaps?
Or try your own language and use Google translate or similar?


Transitive errors in expect.toPass reported as Errors in report

Another minor issue.
I have an expect.toPass block like this
    await page.getByRole('button', { name: 'Rotate Right' }).click()
    await expect(async () => {
      const newBox = (await image.boundingBox())!
      expect(newBox.width).toEqual(oldBox.height)
      expect(newBox.height).toEqual(oldBox.width)
    }).toPass()

Where it will retry the block until all the expects pass. This works fine, but monocart report lists them as 'Errors' even though all the tests pass:
[MR] test results: Monocart Test Report
┌───────────────┬─────────────────────────┐
│ ├ Tests       │ 46                      │
│ │ ├ Passed    │ 46 (100.0%)             │
│ │ ├ Flaky     │ 0  (0.0%)               │
│ │ ├ Skipped   │ 0  (0.0%)               │
│ │ └ Failed    │ 0  (0.0%)               │   < ---- Nothing failed
│ ├ Steps       │ 1249                    │
│ ├ Suites      │ 16                      │
│ │ ├ Projects  │ 2                       │
│ │ ├ Files     │ 9                       │
│ │ ├ Describes │ 15                      │
│ │ └ Shards    │ 0                       │
│ ├ Retries     │ 0                       │
│ ├ Errors      │ 7                       │   < ---- This should be zero
│ ├ Logs        │ 0                       │
│ ├ Attachments │ 0                       │
│ ├ Playwright  │ v1.40.1                 │
│ ├ Date        │ 12/10/2023, 10:58:03 PM │
│ └ Duration    │ 1m 45s                  │
└───────────────┴─────────────────────────┘

the Errors means the count of error messages. is it correct?

This is my personal understanding:
There is an error throwing out does not mean that the test failed, for example a test case is expecting throw an error after running a function, so there is a error message counting but the test should be passed, on the contrary, the test should be failed  if no errors.


test(e2e): add testing for external chain migration

Description
The test spinup another EVM network, initialize the first one first then try initializing the second, adding it as supported chain and removing support for first chain.
Closes: https://github.com/zeta-chain/node/issues/1896

lgtm, approved with 2 small comments, please check if they make sense

Implemented the suggestion


fix(script): assure package.json in repository is a file

📝 Summary

Assure the file retrieved from existing repository is a file and not an unexpected type: dir / submodule / symlink
⛱ Motivation and Context

Fix #8
Once this issue (https://github.com/github/rest-api-description/issues/165) is solved a cleaner solution will set in place by Octokit: https://github.com/octokit/rest.js/issues/1971

Another reason to create a plugin for updating files directly to @octoherd/octokit. We should abstract this all away

Not sureif this should be an Octokit plugin or you want to start an Octoherd plugin ecosystem? @gr2m

I would create an octokit plugin, but create the repository for it under @octoherd. I would like it to support only the latest browsers / Node / Deno version, just like @octoherd. If we made it an official plugin under the @octokit scope/org, we would need to widen the support.
I have some ideas about it, I'll try to get this going today.


AMBARI-23817 : Visualizing the Encrypted zones and Erasure coded zones in HDFS (nitirajrathore)

What changes were proposed in this pull request?
included newer hadoop version and made changes to display the encryption zone and erasure codings in files view UI.
How was this patch tested?
Updated existing test cases to handle changes in hadoop lib. Added test cases in HDFSApi for new fields

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/Ambari-Github-PullRequest-Builder/3634/
Test PASSed.

LGTM


This resolves issue #344

@coke code section is commented out. I would prefer to leave the section in should we change out minds later if a better way emerges to handle all OS/browser combos emerges.

-1 from me on commenting out code - if we want to revert this commit, we can use 'git revert' and restore it.


Text Set - Cover | Robots: "Category" should use a bg fill instead of a seperate shape

Bug Description
Currently the Text Set | Cover | Robots - The Category is using a seperate shape, this should be a background fill instead
context:

Expected Behaviour
Category should use a background fill instead of being a seperate shape.
Steps to Reproduce

Screenshots

Additional Context

Plugin Version:
Operating System:
Browser:

Do not alter or remove anything below. The following sections will be managed by moderators only.
Acceptance Criteria

Implementation Brief

verified in qa

Verified in UAT


Write sig-tool

Unless anyone objects we can call the tool binary sig initially for experimentation purposes and then later rebrand it as stackage sig.
Commands:

sig init — create a dummy config file under ~/.sig/config. This should happen automatically, but can be there to start with.
sig update — download the archive.
sig sign dist/foo.tar.gz — sign the archive and upload the .asc file to sig-service.
sig mappings — list available mappings.
sig trust <fingerprint> <email> — specify to trust e.g. the mapping provided by fpco.yaml, this will prompt to modify the ~/.sig/config file. Link to section.
*~~ sig check <package-name> — check whether a package and all of its dependencies are verifiable. One might want to do this without actually installing the package. cabal install --dry-run should be a way to produce that list easily.~~ This is now --dry-run on install.
sig install <package-name> — check whether a package and all of its dependencies are verifiable and if so then install that package with cabal install.

Should sign also insert the .asc into the local archive on disk?

I suppose it could be useful for debugging to put it in dist/ alongside the .tar.gz , but it's not strictly necessary for the process. Add if you want.

Since all of these commands work (at least in the path that works), I'm closing this as done.  Let's open new tickets like #2 for new stuff or fixes.


Improve Bear import

Recently, I tried to import my Bear notes. I faced a few issues which this PR addresses:

File timestamps are set to the import time, not the actual creation or modification of the note
Roughly half of the files are marked as skipped (#181) without any explanation
Notes from archive and trash are imported like normal notes

@tgrosinger Thanks for your feedback.

Thank you @nicolashohm!


Support Graql update query

What is the goal of this PR?
We have added support for the update query.
What are the changes implemented in this PR?

Updgrade Graql for the GraqlUpdate object
Update Protocol for the Update protocol definition
Added update methods in QueryManager

There are many failing tests, perhaps because the Grakn Core artifact has not been updated?

There are many failing tests, perhaps because the Grakn Core artifact has not been updated?


Rsdk-6117: getaccuracy v3

converting gga fix response to int

@Simberific, this needs to be approved by you since this is an api breaking change.


Clean up: specimen set

MINOR changes:

improved instructions

MAJOR changes:
none
SPECIAL ATTENTION:

removed quantity from concept schema, but property won't disappear; each specimen set gets a more specific property (numberOfXY) which askes for the same information

@apdavison @Peyman-N could one of you confirm in addition (also to make sure that you are aware of this change)


tra seem to be wrt dicom origin rather than 'autoscoper' origin

When generating VRG from a static volume or from a seqence, the Origin2DICOM transform represents relationship between dicom space and aut space.

Dicom space
Origin2DICOM used to express volume in AUT space

:warning: AUT space (center of volume and VRGs) is the space from which .tra transforms should be expressed. Taking  .tra : the positions are not in appropriate anatomical location. See below.

AUT space (center of volume and VRGs) is the space from which .tra transforms should be expressed. Taking  .tra : the positions are not in appropriate anatomical location
@NicerNewerCar pointed- they appear translationaly to be in DICOM basis:

Attempting to branch at commit 9950058, mar 28th just before commit 24c43b6

unfortunately in that bracnh build the origin2dicom tfm was not being generated for either a static 3d ct or the seq volume

Based on https://github.com/BrownBiomechanics/SlicerAutoscoperM/issues/102#issuecomment-2165950975 from @amymmorton , regression possibly introduced through pull request:

https://github.com/BrownBiomechanics/SlicerAutoscoperM/pull/68

originally intended to address:

https://github.com/BrownBiomechanics/SlicerAutoscoperM/issues/56

@amymmorton To allow me to more easily reproduce the problem, would it be possible to provide  the steps & input files allowing to reproduce the problem in SlicerAutoscoperM ?

Originally shared in email from @NicerNewerCar
Autoscoper
Slicer Scene

The data originally pprovided 4/29:  BN00107

Something odd about Origin2DICOM
when applied to the 'target' pose CT dicoms- the origin should be geometric center in the volume- but it's not:

yellow is neutral - bone color rendering is flexion with Origin2DICOM applied

Something odd about Origin2DICOM
when applied to the 'target' pose CT dicoms- the origin should be geometric center in the volume- but it's not:

This is happening because the Origin2Dicom Transform is created from the 1: neutral volume. The 4: flexion volume has a smaller Z dimension and because of that ends up slightly off center from the origin in the z direction.

It Looks like the Origin2Dicom is not getting applied correctly or is getting removed before/during the VRG generation.

Slicer No O2D tfm
Slicer O2D
Autoscoper

Working on a fix for this now


Remove mlock and vhangup from the default seccomp profile

These syscalls are already blocked by the default capabilities:
mlock mlock2 mlockall require CAP_IPC_LOCK
vhangup requires CAP_SYS_TTY_CONFIG
There is therefore no reason to allow them in the default profile
as they cannot be used anyway.
Signed-off-by: Justin Cormack<EMAIL_ADDRESS>Note I am planning to align the default seccomp filter with the capabilities the user selects and I found these during the audit for this.
// cc @jfrazelle

looks good to me
On Thu, Apr 21, 2016 at 10:36 AM, Justin Cormack<EMAIL_ADDRESS>wrote:

These syscalls are already blocked by the default capabilities:
mlock mlock2 mlockall require CAP_IPC_LOCK
vhangup requires CAP_SYS_TTY_CONFIG
There is therefore no reason to allow them in the default profile
as they cannot be used anyway.
Signed-off-by: Justin Cormack<EMAIL_ADDRESS>Note I am planning to align the default seccomp filter with the
capabilities the user selects and I found these during the audit for this.
// cc @jfrazelle https://github.com/jfrazelle
[image: goat]
https://cloud.githubusercontent.com/assets/482364/14718613/9f2a8194-07ef-11e6-926b-744566c3795d.jpg
You can view, comment on, or merge this pull request online at:
https://github.com/docker/docker/pull/22230
Commit Summary

Remove mlock and vhangup from the default seccomp profile

File Changes

M profiles/seccomp/default.json
https://github.com/docker/docker/pull/22230/files#diff-0 (20)
M profiles/seccomp/seccomp_default.go
https://github.com/docker/docker/pull/22230/files#diff-1 (20)

Patch Links:

https://github.com/docker/docker/pull/22230.patch
https://github.com/docker/docker/pull/22230.diff

—
You are receiving this because you were mentioned.
Reply to this email directly or view it on GitHub
https://github.com/docker/docker/pull/22230

--
Jessie Frazelle
4096R / D4C4 DD60 0D66 F65A 8EFC  511E 18F3 685C 0022 BFF3
pgp.mit.edu http://pgp.mit.edu/pks/lookup?op=get&search=0x18F3685C0022BFF3

thanks for working on this :)
On Thu, Apr 21, 2016 at 11:36 AM, Jessica Frazelle<EMAIL_ADDRESS>wrote:

looks good to me
On Thu, Apr 21, 2016 at 10:36 AM, Justin Cormack<EMAIL_ADDRESS>
wrote:

These syscalls are already blocked by the default capabilities:
mlock mlock2 mlockall require CAP_IPC_LOCK
vhangup requires CAP_SYS_TTY_CONFIG
There is therefore no reason to allow them in the default profile
as they cannot be used anyway.
Signed-off-by: Justin Cormack<EMAIL_ADDRESS>Note I am planning to align the default seccomp filter with the
capabilities the user selects and I found these during the audit for this.
// cc @jfrazelle https://github.com/jfrazelle
[image: goat]
https://cloud.githubusercontent.com/assets/482364/14718613/9f2a8194-07ef-11e6-926b-744566c3795d.jpg
You can view, comment on, or merge this pull request online at:
https://github.com/docker/docker/pull/22230
Commit Summary

Remove mlock and vhangup from the default seccomp profile

File Changes

M profiles/seccomp/default.json
https://github.com/docker/docker/pull/22230/files#diff-0 (20)
M profiles/seccomp/seccomp_default.go
https://github.com/docker/docker/pull/22230/files#diff-1 (20)

Patch Links:

https://github.com/docker/docker/pull/22230.patch
https://github.com/docker/docker/pull/22230.diff

—
You are receiving this because you were mentioned.
Reply to this email directly or view it on GitHub
https://github.com/docker/docker/pull/22230

--
Jessie Frazelle
4096R / D4C4 DD60 0D66 F65A 8EFC  511E 18F3 685C 0022 BFF3
pgp.mit.edu
http://pgp.mit.edu/pks/lookup?op=get&search=0x18F3685C0022BFF3

--
Jessie Frazelle
4096R / D4C4 DD60 0D66 F65A 8EFC  511E 18F3 685C 0022 BFF3
pgp.mit.edu http://pgp.mit.edu/pks/lookup?op=get&search=0x18F3685C0022BFF3

LGTM

LGTM


last version 1.6.0 not public

@jessehu @stonezdj The last version https://storage.googleapis.com/harbor-bosh-releases/harbor-container-registry-1.6.2.tgz
is not public could you change the permission ? :-)

Read permission granted. Thanks @obeyler


LongVectorLowering and ThreeElementVectorLowering don't handle constexpr pointers correctly

While transitioning LongVectorLowering to handle opaque pointers, I encountered an issue with the way these passes handle constexpr pointers. For example:
target datalayout = "e-p:32:32-i64:64-v16:16-v24:32-v32:32-v48:64-v96:128-v192:256-v256:256-v512:512-v1024:1024"
target triple = "spir-unknown-unknown"

@gv = internal global <8 x i32> zeroinitializer, align 32

define void @test() {
entry:
  %load = load <8 x i32>, <8 x i32>* getelementptr (<8 x i32>, <8 x i32>* @gv, i32 1), align 32
  %load2 = load i32, i32* getelementptr (<8 x i32>, <8 x i32>* @gv, i32 1, i32 0), align 32
  ret void
}

%load is handled correctly, but %load2 is not handled because the pointer does not appear to require lowering. With opaque pointers, the easier implementation would likely also have a problem with %load too.
A potential solution might be to attempt to visit the constant pointers when the globals are handled. That is, trace users until a non-constant is encountered.

I have just realized that #905 is part of the first solution.
Note that it is not enough to do it in the SimplifyPointerBitcast part as the inlining of function in ThreeElementVectorLoweringPass and LongVectorLoweringPass can recreate  them.

It feels like this is now fixed

closing the issue. Feel free to reopen if I missed something


Write personal description

See CDS for an example. may also include areas of interest such as Open Source Software, User Experience, Design, etc.

Link?

https://digital.canada.ca/meet-the-team/


Feature/email notification

Status page
-- Participant gets emailed their status page QR code and link upon joining the queue.
-- (BUGFIX) Fixed a bug where the creation of Notification object is not fetching the correct message data.
-- Participants will now get notification messages from staff.
-- added default value to messages "Your turn is here!"
-- Status page has notification modal that will flashes red when there are new unread notification.
-- Added wait time and estimated wait time in status page.
-- Leave Queue have has a confirmation prompt.
-- Participant now have auto generated numbers (A001 - A999 - B001)
-- Plays a sound when a new notification comes in.

:warning: Please install the  to ensure uploads and comments are reliably processed by Codecov.
Codecov Report
Attention: Patch coverage is 32.71028% with 72 lines in your changes missing coverage. Please review.

Files with missing lines
Patch %
Lines

participant/views.py
26.66%
33 Missing :warning:

manager/utils/code_generator.py
22.22%
14 Missing :warning:

manager/utils/send_email.py
42.10%
11 Missing :warning:

manager/views.py
10.00%
9 Missing :warning:

participant/models.py
63.63%
4 Missing :warning:

manager/models.py
66.66%
1 Missing :warning:

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.

Flag
Coverage Δ

unittests
33.63% <32.71%> (-0.05%)
:arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Files with missing lines
Coverage Δ

manager/utils/category_handler.py
26.92% <ø> (ø)

participant/forms.py
38.88% <ø> (ø)

participant/urls.py
100.00% <100.00%> (ø)

manager/models.py
35.83% <66.66%> (-0.22%)
:arrow_down:

participant/models.py
61.45% <63.63%> (+2.27%)
:arrow_up:

manager/views.py
19.83% <10.00%> (-0.07%)
:arrow_down:

manager/utils/send_email.py
42.10% <42.10%> (ø)

manager/utils/code_generator.py
22.22% <22.22%> (ø)

participant/views.py
34.74% <26.66%> (-0.02%)
:arrow_down:

🚨 Try these New Features:

Flaky Tests Detection - Detect and resolve failed and flaky tests


Create security.md

T

T

Thanks

Hi! Thank you for the PR, but, because of the nature of this repo, we aren't currently accepting outside contributions.


Annotate camo.py, mandrill_client.py, query.py, session_user.py

Automated message from Dropbox CLA bot
@iamaspacecow, it looks like you've already signed the Dropbox CLA. Thanks!

Looks good, will merge once this passes tests!

Merged, thanks @iamaspacecow!


Add proxy/CN to metrics with config switch

We are removing the CN/proxy/pod labels from the control plane metrics as they cause heavy memory use
(and way heavier when queried) on Prometheus.
For 0.8, we should add a metric configuration such that smaller clusters that do not expect to have problems with
the memory use in this situation, can still make use of specific labels to classify information down to pod/CN/proxy
level.

Metrics                    [X]
Scalability/Perf        [X]

@eduser25 Are we planning to add a switch for the namespace label as well?

I will close this for the time being. It's too expensive even at realistic low numbers to implement, as prometheus mem consumption explodes due to the large number of unique labels.


Commands and Command Manager

Adding all necessary commands for the production.
Setting up a command manager as well as command handling.

might be handy to add a method to register multiple commands at the same time instead of doing:
registerCommands(new Ping());
registerCommands(new BotInfo());
registerCommands(new Kick());
registerCommands(new Ban());
registerCommands(new Unban());

you could do:
registerCommands(new Ping(), new BotInfo(), new Kick(), new Unban());

might be handy to add a method to register multiple commands at the same time instead of doing:
registerCommands(new Ping());
registerCommands(new BotInfo());
registerCommands(new Kick());
registerCommands(new Ban());
registerCommands(new Unban());

you could do:
registerCommands(new Ping(), new BotInfo(), new Kick(), new Unban());

Thank you, added in  5439ed4


Remove unnecessary duplicated macros.

Description
Removes duplicated macros that became unnecessary after the dbt-spark change at dbt-labs/dbt-spark#445.

Thanks! merging.


Link to the card

Provide on each card an HTTP link to the card (to the edit popin of the card).
On the editing form of a card, add a button "Share it" opening a popin displaying the URL shortener to this card (eg https://demo.kansha.org/d/lkrJf7JdT).

Why, instead of simply opening the card and copy / paste its url ?

There is no url to copy/paste today.

Note: although the share button doesn't exist yet, there's already a method to open a card from the URL: the url must end with #id_card_<card_id>


Loading indicators

Add feedback for the user, when data is loading.
Note https://github.com/VEuPathDB/web-eda/commit/4a446fabec5ce2a9cb5d73f885524fda1d0ead27, which prevents EDAAnalysisListContainer from being unmounted. The implementation of RestrictedPage is meant to prevent this, but it apparently does not. I'm not entirely sure where to add an issue for this, since we aren't using Github issues in that repo :smile:.
fixes #171

Since this commit addresses the un-mounting issue, I reverted https://github.com/VEuPathDB/web-eda/pull/403/commits/e8109b7d1a828d15bb7d7c3e254d57f746fc37ca.

Well, somehow my revert did not go as planned, so I pushed a new commit that undoes the change.


Data Ingestion Stage

[x] create the stage 1 file in research
[x] update config.yaml file
[x] update the entity
[x] update the configuration manager in config src
[x] update the components
[x] update the pipeline
[ ] test cases updated

Dry run has been tested


[FEAT] API endpoint to Retrieve Authenticated User's Organisations - Backend

Description
Implement a secure API endpoint to list all organizations associated with the authenticated user. Ensure the endpoint only returns the user's organizations and handles unauthorized and forbidden request errors properly.
Acceptance Criteria
Authentication

The endpoint should be protected and require the user to be authenticated.
If the user is not authenticated, the endpoint should return a 401 Unauthorized status with an appropriate error message.

Fetch User Organisations

The endpoint should fetch all organisations the authenticated user belongs to or has created.
The fetched organisations should only include those associated with the authenticated user.

Successful Response

If successful, it should return a 200 OK status code.
The response should include a list of all organisations the user belongs to.

Endpoint:
[GET] /api/v1/organisations

Requests
GET /api/v1/organisations
Content-Type: application/json
Authorization: Bearer <access_token>

No request body or parameters required.

Successful Response
{
  "status": "success",
  "message": "Organizations retrieved successfully",
  "data": {
	"organisations": [
  	{
    	"orgId": "123e4567-e89b-12d3-a456-426614174000",
    	"name": "Tech Innovators",
    	"description": "A company focused on innovative tech solutions."
  	},
  	{
    	"orgId": "123e4567-e89b-12d3-a456-426614174001",
    	"name": "Health Solutions",
    	"description": "Providing advanced healthcare services and products."
  	}
	]
  }
}

Error Response
401 Unauthorized
{
  "status":  "Unauthorized",
  "message":  "Unauthorized. Please log in."
  “status-code”: 401
}

403 Forbidden
{
  "status":  "Forbidden",
  "message":  "Forbidden. You are not authorized to access these organisations."
  “status-code”: 403
}

Purpose
Allow authenticated users to retrieve a list of organisations they created or belong to, therefore ensuring secure and accurate data retrieval.
Requirements

[ ] Endpoint is protected and requires user authentication.
[ ] Endpoint returns only the organizations associated with the authenticated user.
[ ] Organisation object returned contains necessary fields
[ ] Endpoint returns proper error messages for unauthorized and forbidden access attempts.

Expected Outcome

[ ] Authenticated users should receive a list of their organizations with the necessary fields.
[ ] Unauthenticated users should receive an HTTP 401 Unauthorized error.
[ ] Proper error handling ensures security and reliability of the endpoint.

Testing:
Unit Tests:

Write unit tests to ensure the endpoint correctly retrieves organisations for authenticated users.
Test that the endpoint only returns organisations associated with the authenticated user.
Test various scenarios, including:
Valid user with multiple organisations.
Valid user with no organisations.
Valid user with organisations they belong to and organisations they have created.
Invalid user or unauthenticated user.

Authentication Tests:

Test that the endpoint returns 401 Unauthorized when the request is made by an unauthenticated user.
Test that the endpoint allows access to authenticated users only.

Authorization Tests:

Test that the endpoint returns 403 Forbidden when an authenticated user attempts to access organisations they do not belong to.
Ensure the endpoint only returns organisations the user is a part of or has created.

This is not how it works

I have seen this before, check for duplication

Its obvious the other was done after ours was done because we are Issue #52 and the other is issue #154

#52 is earlier than yours, your last edit was 10 hours ago and mine was 13 hours ago

Sir, I don't think the features are similar. From my understanding, going by the endpoints
#154: URL: /api/users/:user_id/organisations:
Implementing a feature whereas an authenticated user can view organisations any other user is associated with by providing their user id
#52: [GET] /api/v1/organisations
implementing a feature where an authenticated user can only view the organisations they are associated with and takes no paramaters. It is similar to the endpoint /api/v1/organisations/me.
The logic is different, we can both start working on them?

okay

@Hardeezah I advise you restructure your TITLE and also a bit of your description


Adult Swim: Dying on subtitles

Please follow the guide below

You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your issue (like that [x])
Use Preview tab to see how your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2017.04.17. If it's not read this FAQ entry and update. Issues with outdated version will be rejected.

[x ] I've verified and I assure that I'm running youtube-dl 2017.04.17

Before submitting an issue make sure you have:

[ x] At least skimmed through README and most notably FAQ and BUGS sections
[ x] Searched the bugtracker for similar issues including closed ones

What is the purpose of your issue?

[ x] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

The following sections concretize particular purposed issues, you can erase any section (the contents between triple ---) not applicable to your issue

keybounceMBP:Jack michael$ youtube-dl -v -a dl-list
[debug] System config: []
[debug] User config: [u'-o', u'%(title)s-%(timestamp)6i.%(ext)s', u'-f', u'\nbest[ext=mp4][height>431][height<=576]/\nbestvideo[ext=mp4][height=480]+bestaudio[ext=m4a]/\nbest[ext=mp4][height>340][height<=431]/\nbestvideo[ext=mp4][height>360][height<=576]+bestaudio/\nbest[height>340][height<=576]/\nbestvideo[height>360][height<=576]+bestaudio/\nbestvideo[height=360]+bestaudio/\nbest[ext=mp4][height>=280][height<=360]/\nbest[height<=576]/\nworst', u'--ap-mso', u'Dish', u'--ap-username', u'PRIVATE', u'--ap-password', u'PRIVATE', u'--write-sub', u'--write-auto-sub', u'--sub-lang', u'en,enUS,en-us', u'--sub-format', u'ass/srt/best', u'--convert-subs', u'ass', u'--embed-subs', u'--recode-video', u'mp4', u'--mark-watched']
[debug] Custom config: []
[debug] Command-line args: [u'-v', u'-a', u'dl-list']
[debug] Batch file urls: [u'http://www.adultswim.com/videos/samurai-jack/xcii/', u'http://www.adultswim.com/videos/samurai-jack/xciii/', u'http://www.adultswim.com/videos/samurai-jack/xciv/', u'http://www.adultswim.com/videos/samurai-jack/xcv/', u'http://www.adultswim.com/videos/samurai-jack/xcvi/', u'http://www.adultswim.com/videos/samurai-jack/xcvii/']
[debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8
[debug] youtube-dl version 2017.04.17
[debug] Python version 2.7.5 - Darwin-13.4.0-x86_64-i386-64bit
[debug] exe versions: ffmpeg 3.2.4, ffprobe 3.2.4, rtmpdump 2.4
[debug] Proxy map: {}
[AdultSwim] xcii: Downloading page
[AdultSwim] I3Yw7ynsSUqU5H2jNpRKKg: Downloading JSON metadata
[AdultSwim] I3Yw7ynsSUqU5H2jNpRKKg: Downloading m3u8 information
WARNING: Failed to download m3u8 information: HTTP Error 403: Forbidden
[AdultSwim] I3Yw7ynsSUqU5H2jNpRKKg: Downloading m3u8 information
WARNING: Failed to download m3u8 information: HTTP Error 403: Forbidden
[AdultSwim] I3Yw7ynsSUqU5H2jNpRKKg: Downloading m3u8 information
[AdultSwim] I3Yw7ynsSUqU5H2jNpRKKg: Downloading f4m manifest
[AdultSwim] I3Yw7ynsSUqU5H2jNpRKKg: Downloading f4m manifest
[AdultSwim] I3Yw7ynsSUqU5H2jNpRKKg: Downloading f4m manifest
WARNING: Unable to download f4m manifest: HTTP Error 404: Not Found
[AdultSwim] I3Yw7ynsSUqU5H2jNpRKKg: Downloading f4m manifest
WARNING: Unable to download f4m manifest: HTTP Error 404: Not Found
[AdultSwim] I3Yw7ynsSUqU5H2jNpRKKg: Downloading f4m manifest
WARNING: Unable to download f4m manifest: HTTP Error 404: Not Found
[AdultSwim] I3Yw7ynsSUqU5H2jNpRKKg: Downloading f4m manifest
WARNING: Unable to download f4m manifest: HTTP Error 404: Not Found
WARNING: enUS subtitles not available for I3Yw7ynsSUqU5H2jNpRKKg
WARNING: en-us subtitles not available for I3Yw7ynsSUqU5H2jNpRKKg
[info] Writing video subtitles to: XCII-1491533567.en.ttml
[debug] Invoking downloader on u'http://amd.cdn.turner.com/adultswim/episodes/us_geo/samjack/2017/03/samjack_cc_092_Digital_XCII_bajtweuyuav8w6tva8/hls/samjack_cc_092_Digital_XCII_bajtweuyuav8w6tva8_stream_7.m3u8'
[download] XCII-1491533567.mp4 has already been downloaded
[download] 100% of 581.29MiB
[ffmpeg] Not converting video file XCII-1491533567.mp4 - already is in target format mp4
[ffmpeg] Converting subtitles
WARNING: You have requested to convert dfxp (TTML) subtitles into another format, which results in style information loss
Traceback (most recent call last):
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/runpy.py", line 162, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/runpy.py", line 72, in _run_code
    exec code in run_globals
  File "/Users/michael/bin/youtube-dl/__main__.py", line 19, in <module>
  File "/Users/michael/bin/youtube-dl/youtube_dl/__init__.py", line 464, in main
  File "/Users/michael/bin/youtube-dl/youtube_dl/__init__.py", line 454, in _real_main
  File "/Users/michael/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1896, in download
  File "/Users/michael/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 771, in extract_info
  File "/Users/michael/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 825, in process_ie_result
  File "/Users/michael/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1539, in process_video_result
  File "/Users/michael/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1877, in process_info
  File "/Users/michael/bin/youtube-dl/youtube_dl/YoutubeDL.py", line 1942, in post_process
  File "/Users/michael/bin/youtube-dl/youtube_dl/postprocessor/ffmpeg.py", line 564, in run
  File "/Users/michael/bin/youtube-dl/youtube_dl/utils.py", line 2616, in dfxp2srt
  File "/Users/michael/bin/youtube-dl/youtube_dl/compat.py", line 2526, in compat_etree_fromstring
  File "/Users/michael/bin/youtube-dl/youtube_dl/compat.py", line 2516, in _XML
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/xml/etree/ElementTree.py", line 1654, in close
    self._raiseerror(v)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/xml/etree/ElementTree.py", line 1506, in _raiseerror
    raise err
xml.etree.ElementTree.ParseError: no element found: line 1, column 0
keybounceMBP:Jack michael$

The video is downloaded (this is the first, non-cable login restricted, one). The subtitle file is length 0.

adultswim is currently not supported.

See #12121 for current discussion/update on the Adult Swim extractor.


Documentation is unclear - Can you integrate HDI with non Azure AD-DS?

This article makes reference to Active Directory Domain Services (AD-DS) but only mentions Azure AD-DS (AAD-DS) at the end.  It is unclear from this article whether HDI could be integrated with a AD-DS domain instead of AAD-DS.  Please clarify which versions of AD Domain Services are supported and in which topologies.
Evidence of confusion: https://stackoverflow.com/questions/49745210/is-it-possible-to-integrate-an-hdinsight-cluster-with-on-premises-ad

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: f8fcb095-8df9-9b9c-18f8-92ad6ac6f445
Version Independent ID: b2e4589b-f1af-393a-e8f5-7e2fdac21329
Content: Domain-joined Azure HDInsight architecture
Content Source: articles/hdinsight/domain-joined/apache-domain-joined-architecture.md
Service: hdinsight
Product: unspecified
GitHub Login: @omidm1
Microsoft Alias: omidm

@DonPetry-EY Thanks for the feedback! I have assigned the issue to the content author to evaluate and update as appropriate.

@DonPetry-EY
Thanks for the feedback. The article has recently been reworked a bit.
If you have further concerns, please let us know.
Thanks, Jason
CC: @omidm1

#please-close

The article mentions the possibility of having AD FS + PHS (Federated domain so PHS used as backup option) and still be able to configure Azure AD DS and integrate with HDInsight. Is it correct?


MF-1787 - Incorrect response code for CoAP POST messages

What does this do?
This pull request fixes status code for the POST requests sent to CoAP adapter from 2.05-Content to 2.01-Created.
Which issue(s) does this PR fix/relate to?
This pull request fixes #1787.
List any changes that modify/break current functionality
There are no breaking changes except this change in the response status code.
Have you included tests for your changes?
No.
Did you document any new/modified functionality?
No.
Notes
N/A

Codecov Report

Merging #1788 (d7688dc) into master (3b84258) will not change coverage.
The diff coverage is n/a.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.
@@           Coverage Diff           @@
##           master    #1788   +/-   ##
=======================================
  Coverage   70.29%   70.29%
=======================================
  Files         146      146
  Lines       11518    11518
=======================================
  Hits         8097     8097
  Misses       2765     2765
  Partials      656      656

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more


Fix Account being nil after authentication plug

Steps to reproduce:

sign into your account
stop the app
drop the DB
create the DB again, and migrate
run the app
navigate to the main page

You will see the account is nil.
That's probably because of
  # dert-gg/apps/dert_gg_web/lib/dert_gg_web/auth/browser/pipeline.ex

  plug Guardian.Plug.LoadResource, allow_blank: true

I don't get this anymore, not sure why that was even happening before.


D3 timer is behaving erratically with elapsed time even going backward.

I don't know if it is my browser or monitor or computer system but something is way off.
on this site. http://using-d3js.com/08_04_timers.html
I went to find out about interval. when I change the ms values to a lower value they just go fast and then you can't reset it. you have to refresh the browser. It could just be a bug on his webpage.
However, on my system I am trying to use it and look at the logs of what the elapsed time is returning time. It is like it is going backward in time. How is this possible. Is this a bug or just my system. I am developing on my localhost but still this seems very erratic
app.component.ts:626 TIGER 7 MADEN  94952.90000003576
00:18:50.260 app.component.ts:627 TIGER 8 MADEN  94944
00:18:50.261 app.component.ts:626 TIGER 7 MADEN  92480.40000003576
00:18:50.261 app.component.ts:627 TIGER 8 MADEN  92471.5
00:18:50.261 app.component.ts:626 TIGER 7 MADEN  7247.5
00:18:50.261 app.component.ts:627 TIGER 8 MADEN  7238.599999964237
00:18:50.270 app.component.ts:626 TIGER 7 MADEN  94962.40000003576
00:18:50.270 app.component.ts:627 TIGER 8 MADEN  94952.90000003576
00:18:50.270 app.component.ts:626 TIGER 7 MADEN  92489.90000003576
00:18:50.271 app.component.ts:627 TIGER 8 MADEN  92480.40000003576
00:18:50.271 app.component.ts:626 TIGER 7 MADEN  7257
00:18:50.271 app.component.ts:627 TIGER 8 MADEN  7247.5
00:18:50.281 app.component.ts:626 TIGER 7 MADEN  94973.30000001192
00:18:50.281 app.component.ts:627 TIGER 8 MADEN  94962.40000003576
00:18:50.281 app.component.ts:626 TIGER 7 MADEN  92500.80000001192
00:18:50.281 app.component.ts:627 TIGER 8 MADEN  92489.90000003576
00:18:50.282 app.component.ts:626 TIGER 7 MADEN  7267.899999976158
00:18:50.282 app.component.ts:627 TIGER 8 MADEN  7257
00:18:50.289 app.component.ts:626 TIGER 7 MADEN  94981.5
00:18:50.289 app.component.ts:627 TIGER 8 MADEN  94973.30000001192

app.component.ts:627 TIGER 8 MADEN  192203.5
00:20:27.520 app.component.ts:626 TIGER 7 MADEN<PHONE_NUMBER>0002384
00:20:27.520 app.component.ts:627 TIGER 8 MADEN  189731
00:20:27.520 app.component.ts:626 TIGER 7 MADEN<PHONE_NUMBER>9998808
00:20:27.520 app.component.ts:627 TIGER 8 MADEN<PHONE_NUMBER>9996424
00:20:27.528 app.component.ts:626 TIGER 7 MADEN  192220
00:20:27.528 app.component.ts:627 TIGER 8 MADEN<PHONE_NUMBER>0002384
00:20:27.528 app.component.ts:626 TIGER 7 MADEN  189747.5
00:20:27.528 app.component.ts:627 TIGER 8 MADEN<PHONE_NUMBER>0002384
00:20:27.528 app.component.ts:626 TIGER 7 MADEN<PHONE_NUMBER>9996424
00:20:27.528 app.component.ts:627 TIGER 8 MADEN<PHONE_NUMBER>9998808
00:20:27.536 app.component.ts:626 TIGER 7 MADEN<PHONE_NUMBER>0003576
00:20:27.536 app.component.ts:627 TIGER 8 MADEN  192220
00:20:27.536 app.component.ts:626 TIGER 7 MADEN<PHONE_NUMBER>0003576
00:20:27.536 app.component.ts:627 TIGER 8 MADEN  189747.5
00:20:27.537 app.component.ts:626 TIGER 7 MADEN  104523
00:20:27.537 app.component.ts:627 TIGER 8 MADEN<PHONE_NUMBER>9996424
00:20:27.544 app.component.ts:626 TIGER 7 MADEN<PHONE_NUMBER>9998808
00:20:27.545 app.component.ts:627 TIGER 8 MADEN<PHONE_NUMBER>0003576
00:20:27.545 app.component.ts:626 TIGER 7 MADEN<PHONE_NUMBER>9998808
00:20:27.545 app.component.ts:627 TIGER 8 MADEN<PHONE_NUMBER>0003576
00:20:27.545 app.component.ts:626 TIGER 7 MADEN<PHONE_NUMBER>9995232
00:20:27.545 app.component.ts:627 TIGER 8 MADEN  104523
00:20:27.553 app.component.ts:626 TIGER 7 MADEN<PHONE_NUMBER>9998808
00:20:27.553 app.component.ts:627 TIGER 8 MADEN<PHONE_NUMBER>9998808
00:20:27.553 app.component.ts:626 TIGER 7 MADEN<PHONE_NUMBER>9998808
00:20:27.553 app.component.ts:627 TIGER 8 MADEN<PHONE_NUMBER>9998808
00:20:27.554 app.component.ts:626 TIGER 7 MADEN<PHONE_NUMBER>9995232
00:20:27.554 app.component.ts:627 TIGER 8 MADEN<PHONE_NUMBER>9995232
00:20:27.561 app.component.ts:626 TIGER 7 MADEN<PHONE_NUMBER>0003576
00:20:27.561 app.component.ts:627 TIGER 8 MADEN<PHONE_NUMBER>99988

We can’t help you debug if you don’t share any code. 🤷
For what it’s worth, when I run d3.interval with a delay of 1000, I see elapsed times like this:

The code is:
const elapseds = [];
const i = d3.interval((elapsed) => elapseds.push(elapsed), 1000);
await new Promise((resolve) => setTimeout(resolve, 20000));
i.stop();

Live notebook: https://observablehq.com/d/ad4e29ed53586db7
If you want help, I suggest trying a discussion on the d3 repo, or Stack Overflow. Good luck!


Type API - Incorrect documentation

Hello !
In the documentation, it is written that you can retrieve the type of a table in this way:
const users = pgTable('users', {
  id: serial('id').primaryKey(),
  name: text('name').notNull(),
});

type SelectUser = users.$inferSelect;
type InsertUser = users.$inferInsert;

But shouldn't it be done like this?
const users = pgTable('users', {
  id: serial('id').primaryKey(),
  name: text('name').notNull(),
});

type SelectUser = typeof users.$inferSelect;
type InsertUser = typeof users.$inferInsert;

Without the typeof, Typescript returns the error "Cannot find namespace" 😅!
Thanks for your work!

nice find, was just trying .$inferSelect which is a pretty neat api and got disappointed that is not working
would be nice if $inferSelect would return a type directly as in the docs stated (and if possible)

This is fixed now


Add REST API and clean up some DB code

Note that proper package to supply daemon is "python-daemon" as noted in requirements.txt
Doing a "pip install daemon" will grab the wrong package and cause problems.

man I love flask

Traceback (most recent call last):
  File "globus_harvester.py", line 91, in <module>
    repo.crawl()
  File "C:\Users\axfel\Desktop\globus_oai\harvester\HarvestRepository.py", line52, in crawl
    self.repository_id = self.db.get_repo_id(self.url, self.set)
  File "C:\Users\axfel\Desktop\globus_oai\harvester\DBInterface.py", line 180, in get_repo_id
    records = self.get_multiple_records("repositories", "repository_id", "repository_url", repo_url, extrawhere)
  File "C:\Users\axfel\Desktop\globus_oai\harvester\DBInterface.py", line 311, in get_multiple_records
    cur.execute(self._prep(sqlstring),  (given_val,))
sqlite3.OperationalError: near "=": syntax error

That never happened when using Postgres! :D

++


ECONNREFUSED happening consistently

I am trying to call findUser and to find the group membership to look for a particular group that the user should belong to. This code is working on windows but when I run it on a Mac, I consistently get ECONNREFUSED or ECONNRESET (more ECONNREFUSED than ECONNRESET) I turned on logging and I see that it is finding the groups but it still gives me the error. I also tried calling isUserMemberOf and I still get the ECONNREFUSED error. Any ideas as why this might consistently work on windows but not on a mac? I also have this app pushed to a docker container and it fails there as well. We do have 1000+ users in our AD and we have multiple nested groups. Is it because it's making to many calls too fast? Is there a way to throttle it?
Mac OSX - 10.10.5
Node - v4.2.0
NPM - v2.14.7
Activedirectory - v0.7.1
ldapjs - v1.0.0

Can you provide some example code to reproduce the problem? I've never tested the module on a Mac but the majority of my development for this module is done on Linux which shares a lot of similarities with Mac OS.
Without code available, my guess would be that there are too many requests being made to the server and it is actively refusing them. What type of hardware and resources are on your domain controller? Are there any query restricts or limits on the server (either on the server or "in front" of the server? Have you monitored your domain controller CPU and memory usage to see if there are any anomalies, etc.
There isn't currently any throttling within the module. Group enumeration is an "expensive" operation and should not be done within a loop or for a large batch of users. In order to get all groups for a user, each group must be enumerated to get that groups group recursively until exhausted. These enumerations are done recursively with additional ldapjs clients as needed. In addition, if a result uses RangeRetrieval attributes, those are also recursively called asynchronously with additional ldapjs clients.
I run this module on a ActiveDirectory installation with over 15000 users... and over 1000+ groups which are heavily nested.

Thanks for the prompt reply. Here is the piece of code I'm running:
app.use(function (req, res, next) {
  if (!req.session.user) {
    var ntlmUserName = ''; //ntlm username here
    var group = ''; //group here
    console.log('ntlmUserName: ', ntlmUserName);
    console.log('group: ', group);
    activedirectory.findUser({includeMembership: ['user']}, ntlmUserName, function (err, user) {
      if (err) {
        res.status(500).send('Cannot connect to active directory: ' + err);
      } else {
        console.log(user);
        console.log(user.groups);
        user.groups = user.groups.map(function (item) { return item.cn; });
        if (user.groups.indexOf(group) !== -1) {
          req.session.user = user;
          next();
        } else {
          res.status(403).send('Forbidden');
        }
      }
    });
  } else {
    next();
  }
});

This is the config for connection
      connection: {
        url: 'ldap://url.com',
        baseDN: 'dc=domain,dc=com',
        username: 'service-account',
        logging: {
          name: 'activedirectory',
          streams: [{
            level: 'trace',
            path: 'ad.json'
          }]
        }
      },
      allowedgroup: 'group-to-find'

the password is being set on the environment variable for the service account.
This comes back for my username and in the log it says I have 433 nested groups. It finds the group that I am looking for but the only problem is it's called the callback function with the error long before this has completed. I don't have any other for loops or anything. I'm not sure about the hardware that's running the domain controller since it's all handled by IT and i don't have access to it. I can try and find out but my confusion comes from this working on windows with exact same node version but not working on mac. I have tried to hammer the domain controller from my windows machine and it doesn't even flinch, comes back 100% of the time but on the mac side, it fails 100% of the time.

Where you able to get this resolved?

no, i haven't had time to dive into this. I switched from node to .net :( I'll look into this some more later when I have a little bit more free time.

FWIW I have this issue aswell and it's painstakingly annoying.


add clinvar_gene_phenotype column. closes #635.

This converts the clinvar phenotype to all lower-case so that we don't
need to worry about case. All phenotypes for a gene are given for each
gene in '|'-delimited order.

Awesome work, Brent. This will be incredibly useful.

Awesome!