HDDS-4888. Merge basic CI checks

What changes were proposed in this pull request?

Merge basic CI checks (author, bats, etc.) into a single check with matrix build.  This reduces code duplication.
~Add scripts to install check-specific dependencies (eg. bats or spotbugs).  This reduces complexity of Github-specific code in the workflow definition, and allows simpler prototyping/testing.~ (Extracted to HDDS-4969.)
Use Github Actions cache instead of building inside ozone-build container.  This reduces the effect of outdated dependencies in the image.
Prefer check-specific cache because:

various checks require slightly different dependencies (mostly related to Maven plugins)
concurrent checks may have problem sharing cache (noticed with compile (8) and compile (11) checks)
If check-specific cache is not available, fallback to shared cache at restore time.

https://issues.apache.org/jira/browse/HDDS-4888
How was this patch tested?
https://github.com/adoroszlai/hadoop-ozone/actions/runs/732631557

With this approach:

we can cache the ./.dev-tools directory itself which can make next builds faster
./.dev-tools can be populated during the local script executions. Easy to run any test as required tool will be downloaded (and persisted) first time.

Unfortunately this does not work for the kubernetes check.  K3s installs stuff to global directories (/etc).
It also does not apply to Robot Framework installed via pip.

Unfortunately this does not work for the kubernetes check. K3s installs stuff to global directories (/etc).
It also does not apply to Robot Framework installed via pip.

robotframework can be installed with virtualenv + pip to local directory (As far as I remember it worked for me, but let me know if it doesn't)
Kubernetes is a more tricky question:
flekszible can be installed to local dir
I think the installation of k3s can remain in the github actions (if possible). K3s is just one way to provide kubernetes cluster. I think hadoop-ozone/dev-support/checks/kubernetes.sh should assume that we have working kubernetes install (similar that we assume that java and maven are available, we don't install them).
I can imagine that someone would like to execute tests on minikube (or any other one node local k8s cluster).
In github action environment we know that k3s should be installed, but locally it's not so straightforward, therefore I would skip the installation from the script. (We can print out a warning and recommend k3s installation if kubectl is not on the path)

Thanks @elek for the review.


Adds helper function lnrpc.RPCTransaction to create a single lnrpc.Transaction and refactors lnrpc.RPCTransactionDetails

Description
Currently inside SubscribeTransactions the streamed lnrpc.Transaction structure does not get its Label field populated, which seems to be an oversight.
This PR adds a helper function lnrpc.RPCTransaction to return a single lnrpc.Transaction and refactors the helper function lnrpc.RPCTransactionDetails. This is alos used inside SubscribeTransactions to make sure the Label field is correctly populated and have the creation of a RPC Transaction in one place.
Fixes #5853

Can you please add this to the 0.14.2 release notes, so we can get this merged? Thanks.

Thanks! I have rebased and added release notes to 0.14.2

@bjarnemagnussen can you rebase again? The UI shows there's a merge conflict, but then doesn't actually say what it is....

@bjarnemagnussen can you rebase again?

Done! Let me know if is still causing some issues


feat: use bee-js instead axios calls

TODO:

[ ] API health is always green
[ ] fix rest of the type issues
[ ] replace the import with latest bee-js release

I am closing this PR since tackling all the bee-js calls at once means huge refactor. I'll break this down into smaller chunks.


The number of draw calls keeps showing a zero when using the overdraw debug draw mode in Forward+

Tested versions
4.2.2-stable, 0e9caa2d9cb20737f8dcf08b75fcf2a78d980569
System information
WIndows 11 - Vulkan Forward+
Issue description
Forward+ rendering mode failed to count draw calls properly when using "Overdraw" mode (And RENDER_TOTAL_OBJECTS_IN_FRAME). It keeps showing a zero instead of one or more. but it does count some rendering calls like shadows
Occurs both in an editor and a runtime. but doesn't occur in Mobile and Compatibility mode

Steps to reproduce
Switch to the Forward+ rendering mode (if using other modes)

Add some MeshInstances3D to the scene.
Changing to Overdraw mode (Top-left button in a viewport > "Display Overdraw")
Enable "View Information" (Top-left button in a viewport > "View Information")
Observe the number of draw calls in the right-bottom panel of a viewport.

Minimal reproduction project (MRP)
N/A

For context for whoever wants to work on this, here is where we track draw calls in the Forward+ renderer https://github.com/godotengine/godot/blob/06fbc8395b3c0ec6fa38588caea2ee94837f7b97/servers/rendering/renderer_rd/forward_clustered/render_forward_clustered.cpp#L770

small findings so far:
elements for RENDER_LIST_OPAQUE rl->elements.size() is 0, so element_total is 0,  thus VIEWPORT_RENDER_INFO_DRAW_CALLS_IN_FRAME doesnt get incremented.

https://github.com/godotengine/godot/blob/ee363af0ed65f6ca9a906f6065d0bd9c19dcf9e4/servers/rendering/renderer_rd/forward_clustered/render_forward_clustered.cpp#L1033C1-L1042C7

but doesn't occur in Mobile and Compatibility mode

fyi object count doesnt seem correct either for me on all display mode of Mobile and Compatibility Mode:

will update when I understand more

fyi object count doesnt seem correct either for me on all display mode of Mobile and Compatibility Mode

AFAIK, the gizmos and grid lines inside the editors are also counted in the draw call counter in Mobile and Compatibility modes. I don't know if this was intentional. You may open another issue for these.

AFAIK, the gizmos and grid lines inside the editors are also counted in the draw call counter in Mobile and Compatibility modes. I don't know if this was intentional. You may open another issue for these.

There's already an open issue: https://github.com/godotengine/godot/issues/49820


Release 1.0 RC1

This releases an RC candidate for interactors core and html, also releasing version 5.0.rc1 for material UI interactors

@cowboyd Looks like we released the wrong version of material-ui interactors :( I thought we wanted to use 4.x version to support material-ui components from 4.x branch and up major version when we are ready to ship them for material-ui 5.x version

You are correct. Well we can still release 4.0, just means we'll have a bogus 5.0.0-rc1.0 hanging around when we get to 5.0

Yeah, that's right.


Should I use checkSubscribed() method?

version: Latest
So, FlutterInappPurchase.instance.checkSubscribed(); docs says

Check if a subscription is active on Android and iOS.
This is a quick and dirty way to check if a subscription is active. It is highly recommended to do server-side validation for all subscriptions. This method is NOT secure and untested in production.

I want to know how "DIRTY" this method is in the production environment. Because checking if the user has an active subscription on server-side is a lot of work especially when you have a month, 3 months,6 months and yearly plan.
And if I should not use this method than any suggestions on how to validate if a user is subscribed in a flutter-firebase app.

I used to validate using this

I used to validate using this

How can I use this in Flutter? I don't know node.js, are you suggesting me to use this as firebase-function?

@rdcoder33 You can use firebase-functions or nodejs. It would depend on what dev stacks you are bringing for production.

Hello @hyochan @rdcoder33 @dooboolab how can i check if i any subscription is active already or not?
Otherwise can i have any param in purchasehistory which can give me the details of the transactionexpiry or plan validity in time units?
Is it possible to check that my plan is active or not anyway from this package methods?
Otherwise can you suggest a minimal code to find out the best approach to find the subscription expiry time or list of active subscriptions in flutter in app purchase?
This would be a huge help from you.
Thanks.


CircleCI

It would be good to support CircleCI for linux
Since it has the longest time per job of any free CI platform.
There is an example script in
https://discourse.julialang.org/t/continuous-integration-with-circle-ci/11642/9

It would be best to create/maintain an Orb so that it can be updated without people changing their files, same as AppVeyor.jl/Cirrus.jl. I actually made one a while ago that did the basics but never got too far, I think I own the julia namespace...


Add TaskItem object

This adds a TaskItem object to be used for interacting with the
task_items database table. It will eventually be useful for passing over
RPC as well if necessary.

Nice job on this, Andrew, thanks!
-jay


Request for details on Repository's License

I've noticed that it's governed under a custom license. I have a few questions that I hope can be clarified:

Could you provide a detailed explanation of the terms and conditions of this license?
How does this custom license compare to more common open-source licenses like MIT, GPL, or Apache 2.0?
How does this license affect potential contributors?

https://github.com/keitaroinc/ckan-helm/blob/14308000c65a041fe6c7199c1a7aff9a1a8045ec/NOTICE#L2
Thank you for your attention to these questions.

@ruslanguns this is the License for this repository, as you can see it is licensed under the Apache 2.0
https://github.com/keitaroinc/ckan-helm/blob/master/LICENSE

@stojanovskis1 thanks so much for clarifying my questions.


GWP-ASan returns unaligned memory

We hit a strange segfault in out testing environment after switching to TCMalloc.
Crash is happening on SSE instruction.
   0x000000000ad0fb07 <+23>:	callq  0xe58ed80 <TCMallocInternalNew(size_t)>
   0x000000000ad0fb0c <+28>:	xorps  %xmm0,%xmm0
=> 0x000000000ad0fb0f <+31>:	movaps %xmm0,(%rax)

At this point, rax points into a valid memory. But it is not aligned correctly.
Crashing function allocates object of size 168. Usually that allocation would be aligned at least on 16 bytes. But this allocation is sampled. So it is either sampled by allocation profiler, or comes from GWP-Asan.
(gdb) p $rax
$1 = 0x40a7a0d7ff58
(gdb) p ($rax & tcmalloc::tcmalloc_internal::kTagMask) >> 42
$2 = 0

Here is reproducer for this issue.
diff --git a/tcmalloc/testing/memory_errors_test.cc b/tcmalloc/testing/memory_errors_test.cc
index 87f04d5..c73470d 100644
--- a/tcmalloc/testing/memory_errors_test.cc
+++ b/tcmalloc/testing/memory_errors_test.cc
@@ -263,5 +263,25 @@ TEST_F(TcMallocTest, NonGwpAsanSegv) {
   munmap(p, kPageSize);
 }

+struct BigObject {
+  std::array<char, 168> data = {};
+};
+
+static_assert(sizeof(BigObject) == 168);
+
+TEST_F(TcMallocTest, GWPAsanAlignment) {
+  auto rate = 100 * MallocExtension::GetProfileSamplingRate();
+
+//  MallocExtension::SetGuardedSamplingRate(-1);
+
+  for (int i = 0; i < 1000000; i++) {
+    auto p = new BigObject{};
+    benchmark::DoNotOptimize(p);
+    delete p;
+  }
+
+  MallocExtension::SetGuardedSamplingRate(rate);
+}
+
 }  // namespace
 }  // namespace tcmalloc

This test crashes on my laptop, when built with clang and optimizations enabled.
prime@bee ~/C/tcmalloc (master)> CC=clang bazel  test -c opt //tcmalloc/testing:memory_errors_test --cache_test_results=false
INFO: Analyzed target //tcmalloc/testing:memory_errors_test (0 packages loaded, 0 targets configured).
INFO: Found 1 test target...
FAIL: //tcmalloc/testing:memory_errors_test (see /home/prime/.cache/bazel/_bazel_prime/4db5c5c63d44365b213546136a100c4e/execroot/com_google_tcmalloc/bazel-out/k8-opt/testlogs/tcmalloc/testing/memory_errors_test/test.log)
Target //tcmalloc/testing:memory_errors_test up-to-date:
  bazel-bin/tcmalloc/testing/memory_errors_test
INFO: Elapsed time: 4.648s, Critical Path: 4.59s
INFO: 4 processes: 4 linux-sandbox.
INFO: Build completed, 1 test FAILED, 4 total actions
//tcmalloc/testing:memory_errors_test                                    FAILED in 1.7s
  /home/prime/.cache/bazel/_bazel_prime/4db5c5c63d44365b213546136a100c4e/execroot/com_google_tcmalloc/bazel-out/k8-opt/testlogs/tcmalloc/testing/memory_errors_test/test.log

INFO: Build completed, 1 test FAILED, 4 total actions

After disabling GWP-Asan, test stops crashing.

Thanks for the report and the reproducer!
It looks like GWP-ASan doesn't respect __STDCPP_DEFAULT_NEW_ALIGNMENT__ (typically 16, though adjustable with -fnew-alignment), but rather only aligns to TCMalloc's kAlignment=8.  Consequently, Clang assumes it'll get a 16-byte aligned object and issues movaps...


Public subscribe to ObservablePoint

More a feature request than issue.
Back in the times of PIXI 3.x, it was easy to follow position / scale / anchor / pivot of particular display object in dispersed solutions. Simple assignment b.position = a.position, regardless of good practices conduct, allowed to stick and unstick display objects easily.
Re-designed transformation system in PIXI 4.x put kibosh on it, and among other benefits, made tracking/following changes in position, scale, anchor, pivot as easy and faulty as per frame check or hacky as duck.
Can we make this more friendly?

Some objects are copied and assigned by value even in Flash.
For most use-cases, pixi-display works better than sticking objects together.

I'm not denying that at all. Pixi-display works absolutely perfect. Just wanted to see, if there's a chance for extending the ObservablePoint API rather than changing the way it works.


Catch duplicate resources

Dictionaries in Python don't support duplicate keys. If a YAML/JSON contains duplicate keys, the last occurrence is "used".
If somebody is copy/pasting a bit too enthusiastic in a big template, weird result will happen....  Change a resource, deploy it, nothing changes. Spand hours on debugging only to find out the Resource occorred 2 times in the template... Yes, experienced this.... Pretty annoying.
Example:
AWSTemplateFormatVersion: "2010-09-09"
Resources:
  mySnsTopic:
    Type: AWS::SNS::Topic
    Parameters:
      TopicName: "unused-topic-name"
  myS3Bucket:
    Type: AWS::S3::Bucket
  mySnsTopic:
    Type: AWS::SNS::Topic
    Parameters:
      TopicName: "used-topic-name"

There will be 1 SNS topic deployed, the one with used-topic-name. In this case pretty clear, but in bigger templates this is not desirable.

See also: https://github.com/aws/aws-cli/issues/2404

Totally ran into this when working on the JSON parser to work with tabbed JSON files.  Was wondering how to fix this but this is fantastic.  Thanks i'll review.

Just added the JSON version (somewhere I removed the code for JSON while making assumption)... Actually found a duplicate in the tests


docs: exclude algolia searchParameters

it seems we need to review algolia, searchParameters prevents search working...
fix #1420

closing, fixed on 6082b69


ContentType Header Add/Remove/Re-Add

If you add a Content Type Header, via the Form, then remove it, re-adding it doesn't work.  you have to refresh the screen (F5) to re-add the content type value.

Thanks for reporting. I checked it and it looks like it does not propagate changes in the editor accordly.
I'll look into it right now.

Most likely related to header settings are not saved #345. My guess is you are killing two birds with one stone.
Thanks for looking into this.

Duplicate of #345


Full screen buttons too close from volume bar

Hi, I think the full screen buttons (official and Full screen extension) are too close from volume bar and a bit misaligned, might be a great idea to move them a bit to the right and bottom ?
Both active :

Only the Full screen extension :

Edit : Might be due to the screen resolution ? This bug appear on one of your screenshot but not on another.
Misaligned :

Not misaligned :

@Yashirow Yap it's misaligned we got to fix that
Ill do it and let you know
Thanks

this issue fixed trough #161
@Yashirow conform this fix and let me know please!

Works perfectly with only the Full screen button from the extension but the official one is still misaligned (with the extension or without). Personally I only use the extension so it's okay.
Only extension :

Official + extension :

Only official :

I use this CSS line to hide the official button : button[title="Full screen"] { display: none !important; }
Maybe replacing the display: none !important with padding: x !important and tweaking the x value could work ?

@Yashirow Ill Check it out thanks for your help

@Yashirow  can you check the existence of this issue and let me know?
(check after running the installation script again)

It's still the same as before

@Yashirow try this file please

Fixed with this user.css @SunsetTechuila

only extension and only official too?

Only extension was working before and is still working
Only official also work now


Automated Package Upgrade

:tada: This PR is included in version 25.3.161 :tada:
The release is available on:

npm package (@latest dist-tag)
GitHub release

Your semantic-release bot :package::rocket:


link preview images in home page

Issue Type:

[ ] Bug Report
[x] Feature Request
[ ] Documentaion

Describe the bug

A clear and concise description of what the bug is.

Possible solution

Describe the solution you thought of.

Screenshots

If applicable, add screenshots to help explain your problem.

@jigar-sable may I assign you this ?

Yeah Sure..

If you want you can make these changes in my other two repos also

although I can't give lvl3 in both of them but i will surely give lvl2

@arpit456jain alright will be doing the same soon for CSS & JS repos.

@arpit456jain alright will be doing the same soon for CSS & JS repos.
No worries regarding levels.

that's cool man 🎉  I appreciate

Thanks @arpit456jain


cross db updates

 Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you all sign our Contributor License Agreement before we can accept your contribution.1 out of 2 committers have signed the CLA.:white_check_mark: paul-aiyedun:x: jackjack seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.You have signed the CLA already but the status is still pending? Let us recheck it.


Caesars Cipher: My code pass all the tests but doesn't validate on FCC

Challenge Caesars Cipher has an issue.
User Agent is: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.2704.106 Safari/537.36.
The code pass all the tests but doesn't validate on FCC editor. Why that?
My code:
let engine = (v) => {

  let low = 'A'.charCodeAt();
  let high = 'Z'.charCodeAt();

  if (!!v.match(/[a-z]/i)) {
    if (v.charCodeAt() - 13 < low) {
      let code = (high - (low - (v.charCodeAt() - 13 + 1)));

      return String.fromCharCode(code);
    }
    else {
      return String.fromCharCode(v.charCodeAt() - 13);
    }
  }
  else {
    return v;
  }
};

function rot13(str) { // LBH QVQ VG!

  return '"' + str
    .split('')
    .map(engine)
    .join('') + '"';
}

// Change the inputs below to test
rot13("SERR PBQR PNZC");
rot13("SERR CVMMN!");
rot13("SERR YBIR?");
rot13("GUR DHVPX OEBJA QBT WHZCRQ BIRE GUR YNML SBK.");

I am not an ES6 expert, requesting assistance from @FreeCodeCamp/issue-moderators
By far the output is matching the expected criteria.
The only thing that I can play a hunch is with the error that shows on the Dev Console:

Here is the complete log
Can anyone guide?

Could it be the global scope of 'engine'? Everytime a test runs it tries to define 'engine' again?
I had a quick search in the repo for 'engine' being defined anywhere, but could only find it in some express files as a string.

Nope already checked that, changing the name is not helping. Also I tried refactoring the code to test global declaration to be a problem.
If you check the complete log there is a weird error thrown by the RX.js library which I believe only @BerkeleyTrue has a good understanding of.

I can't run ES6 on my phone, I'll try it out when I get a chance

Sorry guys, but the code is incorrect. Running the code above with two minor changes allows it to pass all tests.
The original code returns a string containing an extra pair of double quotes, eg '"FREE PIZZA!"' instead of 'FREE PIZZA!', and deleting the pair of double quote concatenations in the return statement fixes that problem.
There does seem to be some conflict with the inner workings of the editor when using the variable name engine, but this doesn't stop the tests from passing successfully.

@BKinahan mind submitting your code in here?

@raisedadead It really is the same code as above without the concatenations I mentioned. You may be having the issue where a page refresh is needed to allow test results to be updated, which affects many challenges in certain conditions.
Here's the code anyway for the sake of completeness:
let engine = (v) => {

  let low = 'A'.charCodeAt();
  let high = 'Z'.charCodeAt();

  if (!!v.match(/[a-z]/i)) {
    if (v.charCodeAt() - 13 < low) {
      let code = (high - (low - (v.charCodeAt() - 13 + 1)));

      return String.fromCharCode(code);
    }
    else {
      return String.fromCharCode(v.charCodeAt() - 13);
    }
  }
  else {
    return v;
  }
};

function rot13(str) { // LBH QVQ VG!

  return str
    .split('')
    .map(engine)
    .join('');
}

// Change the inputs below to test
//rot13("SERR PBQR PNZC");
rot13("SERR CVMMN!");
//rot13("SERR YBIR?");
//rot13("GUR DHVPX OEBJA QBT WHZCRQ BIRE GUR YNML SBK.");

Nope this doesn't let me pass the challenge.
I am on Windows 7 - Version 52.0.2743.82 m

Okay I did a full reset and cleared my cache then used the code you mentioned.
Passed with flying colors!
Thanks for the help @BKinahan
Yet I think the test messages are confusing, where a camper will definitely add the quotes as stated.
IMHO we should fix this.

@raisedadead My first attempt was without the quotes. It didn't work so I added the quotes without more success then posted an issue. Now I just removed the quotes and refreshed the page as mentioned by @BKinahan and it works. Weird...

Nice catch @BKinahan , but that has raised two issues:

Unclear instructions for the result expected
codeUri not extracting and running the updated code without a refresh

Yeah @eakl I got that too... I share your frustration.
Anyhow to contributors please update the messages to not have the quotes.
as in:

for all the tests.

Personally, I can't recall ever having to refresh the browser to get some code to run apart from testing this issue.
Does it warrant a separate issue? Does it happen often enough?

@Bouncey It happens to me a lot, but it may be due to my use of ES6 features like arrow functions (which notably are used in this case). More testing needed 😄

@Bouncey It happened 3 times for me so far. Including this challenge.

@eakl to be honest we don't have 100% ES6 support for challenges yet. So it could be anything, to best of my knowledge Chrome has started supporting only in the latest of v52 I think. Many things will be broken.

I've only just started using es6, and never in FCC, so I think it is an ES6 problem

@raisedadead @Bouncey I mostly use ES6 when I can (arrow function, const/let, argument operators, ...). It may be that indeed.

@raisedadead Does your note above imply that all other challenges whose functions return strings should also display them without quotation marks? E.g. Spinal Tap Case, Repeat a string repeat a string, and others..
I haven't seen this type of mistake in relation to this challenge or those others with similar outputs, so it may be quite uncommon. If so it might not justify a broad change, especially for test cases which should return empty strings and can't be represented without the quotes 😄

Yeah, that is correct.
But this is the behavior that you would see in the Dev Console.
So I think its not ambiguous.

But yeah representing empty string would be tough in the test messages.
Any interesting ideas are most welcome

solved this question using the charCode  methods decided to solve it without those methods, solution seems okay but not working.
`function rot13(str) { // LBH QVQ VG!
str = str.toUpperCase().split("");
var abc = ["A","B","C","D","E","F","G","H","I","J","K","L","M","N","O","P","Q","R","S","T","U","V","W","X","Y","Z"];
var indices = [];
var newString = [];
var rot13arr = [];
var newStringrot13arr = [];
function getindices(){
abc.forEach(function(val,index){
if(index + 13 > 25){
indices.push(index -13);
}
else{
indices.push(index + 13);
}
});
}
function newStringFunc(){
str.forEach(function(val){
if(abc.indexOf(val) == -1){
newString.push(val);
}
else{newString.push(abc.indexOf(val));}
});
}
function rot13array(){
newString.forEach(function(val){
if(indices.indexOf(val) == -1){
rot13arr.push(val);
}
else{ rot13arr.push(indices.indexOf(val));}
});
}
function newRot13str(){
rot13arr.forEach(function(val){
if(abc[val] === null ||abc[val] === undefined || abc[val] === ""){
newStringrot13arr.push(val);
}
else{newStringrot13arr.push(abc[val]);}
});
}
getindices();
newStringFunc();
rot13array();
newRot13str();
//var finalString  = newStringrot13arr.join(" ");
//return '"' + finalString + '"';
return newStringrot13arr.join(" ");
}
// Change the inputs below to test
rot13("SERR PBQR PNZC");
`
help needed.

@iykyvic, this place is not for get a help.
Please use the Help chat room for getting challenge related help.
Happy Coding!

@texas2010, thank you for responding, I already solved the problem using the charCode methods, so I don't need help solving this one, I am just asking why this code(previous comment) which works does not pass the test.


SectionList support

Hi Kristoffer,
It will great to have SectionList support, thanks !!!

I agree!!!

I've created an OptimizedSectionList following the structure of the OptimizedFlatList. It's on a fork: https://github.com/otaviogaiao/react-native-optimized-flatlist
Its working for my project, I didn't test with others, but feel free to reach me if you find any bugs. I will make a pull request eventually, once more people had the change to try it.


CAS 5.x Infinispan doesn't remove from cache stores

Using latest 5.0.0.RC5-SNAPSHOT, STs are now validated against Infinispan. The issue I'm seeing now is that TGTs aren't cleaned up against a persistent store.
InfinispanTicketRegistry.deleteSingleTicket() calls cache.evict(). However, that simply removes it from memory, and not a persistent store or cluster:
https://docs.jboss.org/infinispan/8.2/apidocs/org/infinispan/Cache.html#evict-K-
cache.remove() should be called instead.
https://docs.jboss.org/infinispan/8.2/apidocs/org/infinispan/commons/api/BasicCache.html#remove-java.lang.Object-
infinispan.patch.txt

Excellent. Thanks. Could you turn the patch into a PR, or would you rather we apply it directly?

Go ahead and apply the patch directly. I'm still learning GitHub and patches are way easier for me. Especially given the current repo size for CAS.

Cool, thanks.
If you want to, you can easily get a much faster clone with --depth 1 and if you only care about master, you can get away with --single-branch --branch master.

via https://github.com/apereo/cas/commit/42705df0866bb1e40b491e4ef5796076a1fdb919


Curtailment Data

Are there any plans to provide curtailment data similar to what nemlog offers through the OpenNEM front end and API?

We have the data - let me circle with the team and update here

Hey @nc9! Just bumping to see if this would be feasible or if I should close. Thank you!

Feasible yes - it just slipped out feature queue :) - I will track here


How to handle connection interruption/timeout in PubSub listen() ?

What happens when connection to Redis goes down or timeouts while listening to PubSub messages via a long running "pubsub.listen()" ?
Any tips how i can gracefully handle / restart interrupted connection?
I do appreciate your help!
This is the relevant code:
class Listener(threading.Thread):
    def __init__(self, r, channels):
        threading.Thread.__init__(self)
        self.redis = r
        self.pubsub = self.redis.pubsub()
        try:
            self.pubsub.subscribe(channels)
        except ConnectionError:
            print self, "Redis is down"

    def work(self, item):
        print item['channel'], ":", item['data']

    def run(self):
        for item in self.pubsub.listen():
            if item['data'] == "KILL":
                self.pubsub.unsubscribe()
                print self, "unsubscribed and finished"
                break
            else:
                self.work(item)

hi @andymccurdy
trigger = rtunnel.pubsub()
trigger.subscribe('PUSH_NOTIFICATION_GCM_REQUEST')
while True:
try:
for request in trigger.listen():
write_stdout('\n\n Daemon Start: %s - %s UTC'% (request, datetime.utcnow()))
				if request['type'] == 'message':
					queue = rtunnel.lrange("PUSH_NOTIFICATION_GCM_QUEUE", 0, -1)

					for message in queue:
						message = json.loads(message)

						if self.sendPushNotification(message):
							rtunnel.lpop("PUSH_NOTIFICATION_GCM_QUEUE")
							write_stdout('\n\nSuccess: \n  message: %s at %s UTC'% (message, datetime.utcnow()))
						else:
							write_stderr('\n\nError: \n  message: %s at %s UTC'% (message, datetime.utcnow()))

				write_stdout('\n\n Daemon End - %s UTC'% datetime.utcnow())

		except(KeyboardInterrupt, SystemExit):
			sys.exit()
		except:
			write_stderr('\n\nException %s occured at %s UTC'% (traceback.format_exc(), datetime.utcnow()))

I am using AWS elasticCache and running this code using supervisor, What my problem is my listener is not listening if the listener is kept quiet for long (say 4 or 5 days). and once we look for sending messages after 4 or days using "publish" the listener is not working (i.e) not executing the code "trigger.listen():" .
will the listener timeouts after certain hours or days ?
But once we rerun the above code the listener is working perfectly(listening the publish message).
Actually we are having 2 nodes in AWS elastic cache, but for these pubsub we are using master node, so no chance of disconnecting.
We are using 2.10.3 version of redis-py.
Any help will be greatly appreciated.

I too am having issues with the subscriber just not listening according to the publisher (result of the publish is a 0 instead of 1). I've taken steps to ensure that the the thread with the subscribed client is running and will restart if it stops, and the thread is running just fine and everything appears to be in order asides from the fact that the publish returns a 0 indicating nothing is listening. Bouncing the service doing the subscribing fixes it, but that is not a viable solution. As @sriman mentioned above it takes a few days to happen and I can't put my finger on it, but it has happened many many times since we started using redis pubsub months ago.

I have faced this problem mainly because I am using elastic cache of aws it
tends to close the connection sometimes, no specific usecase when it
happens, in the python code whenever connection closes its not reconnected
again. thats why subscriber can't listen to the signal to the subscribe, to
solve this there is option called socket keep alive in this library, give a
shot with that option
On Sat 28 Apr, 2018, 12:48 PM yuzhushang<EMAIL_ADDRESS>wrote:

hi @sriman https://github.com/sriman
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/andymccurdy/redis-py/issues/386#issuecomment-385148175,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ACLmXS54h7W6Z4zRnEnJE30xwfkV3as2ks5ttBevgaJpZM4BEVVc
.

@sriman
thanks, I will try

Hi @andymccurdy and all, I realise the issue is closed, but I still experienced the issue. I would like to recommend a readme update to include explicit shutdown order for removal of the thread interruption error with pubsub, mentioned. For me, this has removed exceptions errors caused by interruption of the thread created in run_in_thread() during application shutdown.
This for the use case as follows:
    p = r.pubsub()
    p.subscribe( **{key: handler_func} )
    t = p.run_in_thread(sleep_time=0.1)

then explicit order for shutdown is:
    t.stop()
    t.join()
    p.close()

Optionally wrapped in try/excepts.
I'm using PyPi release v3.3.8.
Hopefully that will help someone in future with the same issue.
Thanks,


Release prep & other fixes

Okay, here's the 'proper' PR with the most-recent master, sorry again! Repeating from #25:
Hi @SimonGreenhill. Here's a small update for preparing another release of the TNG data. Are you okay with the changes to CONTRIBUTORS or would you prefer any changes?
This PR is not ready for merging insofar as that it contains manual a fix to the upstream data that needs to be verified (I wanted to be able to test/work through the whole pipeline) and potentially fixed upstream?:
diff --git a/raw/languages.json b/raw/languages.json
index fac6b01..8112598 100644
--- a/raw/languages.json
+++ b/raw/languages.json
@@ -4047,7 +4047,7 @@
         "classification": "Trans-New Guinea, Southeast Papuan, Goilalan, Fuyug",
         "dialect": "Kabana",
         "fullname": "Fuyug (Kabana Dialect)",
-        "glottocode": "fuyu124",
+        "glottocode": "fuyu1242",
         "id": 1703,
         "information": "Named variety in Williamson 1912, probably just a clan name",
         "isocode": "fuy",
@@ -4073,7 +4073,7 @@
         "classification": "Trans-New Guinea, Southeast Papuan, Goilalan, Fuyug",
         "dialect": "Korona",
         "fullname": "Fuyug (Korona Dialect)",
-        "glottocode": "fuyu124",
+        "glottocode": "fuyu1242",
         "id": 1702,
         "information": "Named variety in Williamson 1912, probably just a clan name",
         "isocode": "fuy",
@@ -4086,7 +4086,7 @@
         "classification": "Trans-New Guinea, Southeast Papuan, Goilalan, Fuyug",
         "dialect": "Mafulu",
         "fullname": "Fuyug (Mafulu Dialect)",
-        "glottocode": "fuyu124",
+        "glottocode": "fuyu1242",
         "id": 1705,
         "information": "Named variety in Williamson 1912, probably just a clan name",
         "isocode": "fuy",
@@ -4099,7 +4099,7 @@
         "classification": "Trans-New Guinea, Southeast Papuan, Goilalan, Fuyug",
         "dialect": "Sikube",
         "fullname": "Fuyug (Sikube Dialect)",
-        "glottocode": "fuyu124",
+        "glottocode": "fuyu1242",
         "id": 1704,
         "information": "Named variety in Williamson 1912, probably just a clan name",
         "isocode": "fuy",
@@ -13519,4 +13519,4 @@
         "resource_uri": "/api/v1/language/zorop/",
         "slug": "zorop"
     }
-]
\ No newline at end of file
+]

The upstream raw/languages.json has a Glottocode fuyu124 which I assume should be (but I might be wrong) fuyu1242.

Hi, thanks @chrzyki  -- fixed upstream, can you rerun download and rebuild?

Happy with adding @LinguList to CONTRIBUTORS - sorry that should have been done long ago

@SimonGreenhill Could you add the missing fixes? This is one of the last datasets still requiring attention right now.

all the arandai issues have been fixed upstream

The others should be fixable by adding these to the profile --
ndʷ
ndʰ
... but how do you want the <<͡>> handled?

CLTS ignores the bar, as it is not needed, if you have segmentation.

ndʷ must be superscript-n + d + superscript-w
ndʰ must be superscript-n + d + supercript-h
CLTS requires nd to be modeled as pre-nasalized d.

I have pushed a new commit that

fixes the remaining orthography profiles
Ignores languages that are part of the zgraggenmadang, mcelhanonhuon, and robinsonap datasets

@SimonGreenhill Are there any other Lexibank datasets that have been used as a source for TNG.org where we might want to avoid duplicates? E.g. johanssonsoundsymbolic, tryonsolomon, and abvdoceanic? Or are those independent digitizations? If everything is alright, we can merge and release.

Thanks @FredericBlum -- but do we really want to remove the 'duplicates'? that makes this dataset not a faithful reflection of transnewguinea.org, and there can be revisions / fixes / cognates /etc in tng.org that are not in the original datasets?
Surely the deduping should be handled at the lexibank level?

@SimonGreenhill, the problem we have with TNG and some other datasets now is that:

there is a dedicated cldf-dataset, with a dedicated orthoprofile and a dedicated concept list in concepticon
TNG aggregates data like zgraggenmadang AGAIN

Lexibank has a greedy way of selecting the "best" dataset for a language. We just take the one that has more entries. But we want to curate what goes into Lexibank, so we have some direct intention of saying TNG/zgraggenmadang is to be refused over lexibank/zgraggenmadang (Lexibank selects but ONE variety to be reflected in the FormTable).
As TNG is also aggregating data from datasets in the lexibank repository, we have to make a choice, and the preference is the original datasets in lexibank.
The alternative is that TNG adopts the lexibank style and aggregates data itself from Lexibank, but as long as this is not in place, we need to make a decision for the data that goes into TNG/cldf and also into Lexibank 2.0.

An example is the recent dataset I added for lexibank, berrywestpapuan: if that goes into TNG, we have duplicated it, because it started out with lexibank. zgraggenmadang is similar. So my long-term suggestion is: TNG becomes an aggregator as lexibank, and we outsource individual datasets in the future, similar to what I did with berrywestpapuan. But as long as this is not accomplished, we keep the parts not in the lexibank repo (or a dedicated TNG repo with dedicated one-source-as-cldf-datasets) as our default to add languages we'd otherwise miss. We do the same with IDS now: if we get a "better" version of a sub-part, we prefer that and we reduce the core IDS by blacklisting the data (https://calc.hypotheses.org/7503). So our idea is to do the same here with TNG now.
Or are there alternative ways to handle this? Obviously we do not want to have identical language varieties in lexibank that pull from the same sources...

Hi Mattis -- this is a problem for all aggregator databases (ABVD, TNG, DIACL, etc etc). I think handling this way is a bad idea:

It's whack-a-mole -- how far into ABVD etc do you want to dig? who wants to spend time going through all these and blacklisting each and every thing? So now you've tagged some things as duplicates, but there's lots of other things that will be duplicates too that aren't as easy to spot e.g. the data collected in e.g. robinsonap is partly from primary literature. What do you do if TNG and robinsonap have both sourced the same list? you'd need to dedupe to the original rather than thinking robinsonap is the primary (...but the original is not in its own dataset, so then you need to judge which is "better". Good luck).

It's not catching changes that come in as added value into the aggregator datasets (which kind of goes against the whole lexibank idea of enhancing existing datasets).

It's a major disincentive to put your dataset into lexibank. If this goes ahead I'll want to make my own CLDF dataset of tng.org (and ABVD etc). People ask me how to get tng.org, I used to be able to point them to lexibank, now I'd have to say that there is some subset in lexibank, but if you want to get it all you need to download lexibank/tng, languages A,B and C from zgraggenmadang D,E,F from robinsonap. Easier to send them elsewhere.

I don't see why duplicates are actually a problem -- why deduplicate at all? what is a duplicate is often a useful bit of data: Is x the same across these datasets? how has it changed? is dataset x and faithful representation of y?

I agree that the filtering of duplicate content would be better done in lexibank-analysed, rather than here, because this dataset is supposed to contain the data from the provenance context "transnewguinea.org" - and having only a somewhat intransparently incomplete copy of this data here would seem odd.
That said, I also think we should incentivize aggregators like TNG to make their constituent data available in CLDF in a more "atomic" way. One of the lessons learned with lexibank (from my POV) is that such more narrowly focused datasets make it a lot easier to add value - be it orthography profiles or metadata. In addition, this way of adding value is a lot more transparent than comparing duplicate data between atomic datasets and aggregated data. While in theory possible, answering the question "is dataset x and faithful representation of y" right now is certainly difficult.

I agree that narrow focus datasets is easier, but that's a lesson that took me 20 years to learn :)

To elaborate: In an ideal world, both - lexibank and TNG - would be aggregating from a pool of "atomic" datasets; both adding value in different ways. So I think of lexibank and TNG rather as methods not as data.

I guess, for lexibank 2.0 (i.e. lexibank-analysed), the alternatives are

drop TNG entirely
filter upon creation of lexibank-analysed (which is done anyway on a per-glottocode basis, right?)
include TNG as is.

For the future we should aim at breaking out the atomic parts of aggregators, making the first option above more viable - or, possibly even better, realize that the "lexibank method" is understood well enough already for people to apply it to their own favorite aggregates of lexibank datasets themselves.

I forgot I already had a solution in my head that would just leave TNG as is (just discussed that with @FredericBlum and @xrotwang):

we have a flag for each Form in a FormTable of Lexibank-Analysed, where we say 1 for the preferred form and 0 for the non-preferred duplicate
we include all forms in Lexibank, but flag them.

For aggregators like TNG, the future would be to drop them entirely and to work on exporting the individual datasets in there to individual repos (as we have done in part with Zgraggenmadang, etc.).
For now, we can leave TNG, but if TNG keeps aggregating new data from cldf datasets, that are also ending up in Lexibank as individual cldf datasets, we must drop TNG. For now, it works to flag the data in question.

Short clarification question: We create the flag in this dataset, or during the LBA conversion?

Short clarification question: We create the flag in this dataset, or during the LBA conversion?

I'd say during LBA conversion.

Ok. I have adapted this PR accordingly. Coukd you check if we can merge and release this now?

thanks guys, I like the alternative solution and am happy for this to be merged now.


Fix unescaped backslash

There's an unescaped backslash in nf-winbase-setcurrentdirectory.md that leads to nothing being shown instead of the backslash as intended.

@loganrosen : Thanks for your contribution! The author(s) have been notified to review your proposed change.

Thanks for your contribution, I've merged your changes and they should be live soon.


Update address format in OAS

Update IP address format in

[ ] serviceList
[ ] OAS
[ ] CONFIGfile

from e.g.:
new-application-address:
  type: string
  pattern: '^((25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)\.){3}(25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)$'
  description: >
    'IP address of application that shall be target of the handover process
    update or create [/core-model-1-4:control-construct/logical-termination-point=*-0-0-1-tcp-c-0010/layer-protocol=0/tcp-client-interface-1-0:tcp-client-interface-pac/tcp-client-interface-configuration/remote-address/ip-address/ipv-4-address]'

to
new-application-address:
  type: object
  minProperties: 1
  maxProperties: 1
  additionalProperties: false
  properties:
    ip-address:
      type: object
        minProperties: 1
        additionalProperties: false
        properties:
          ipv-4-address:
             type: string
             pattern: '^((25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)\.){3}(25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)$'
             description: >
               'IPv4 address of application that shall be target of the handover process
               update or create [/core-model-1-4:control-construct/logical-termination-point=*-1-0-0-tcp-c-bm-nr-1-0-0-000/layer-protocol=0/tcp-client-interface-1-0:tcp-client-interface-pac/tcp-client-interface-configuration/remote-address/ip-address/ipv-4-address]'
    domain-name:
      type: string
      pattern: '^([a-z0-9]+(-[a-z0-9]+)*\.)+[a-z]{2,}$'
      description: >
        'Domain name of application that shall be target of the handover process
         update or create [/core-model-1-4:control-construct/logical-termination-point=*-1-0-0-tcp-c-bm-nr-1-0-0-000/layer-protocol=0/tcp-client-interface-1-0:tcp-client-interface-pac/tcp-client-interface-configuration/remote-address/domain-name]'

Already covered by other issues.


PVSystem.temperature_model_parameters requirement

The temperature_model_parameters handling code below suggests to me that in 0.8 we're going to

set default values module_type=None and racking_model=None.
require user to specify either temperature_model_parameters or both module_type and racking_model.

https://github.com/pvlib/pvlib-python/blob/27872b83b0932cc419116f79e442963cced935bb/pvlib/pvsystem.py#L208-L221
@cwhanse is that correct?
The problem is that the only way to see this warning is to supply an invalid module_type or racking_model. That's because PVSystem._infer_temperature_model is called before the code above, and it looks up the default module_type and racking_model and successfully finds temperature coefficients.
https://github.com/pvlib/pvlib-python/blob/27872b83b0932cc419116f79e442963cced935bb/pvlib/pvsystem.py#L201-L203
So I'm guessing that this warning has been seen by only a small fraction of people that need to see it. I'm ok moving forward with the removal in 0.8 or pushing to 0.9.

The temperature_model_parameters handling code below suggests to me that in 0.8 we're going to

set default values module_type=None and racking_model=None.
require user to specify either temperature_model_parameters or both module_type and racking_model.

@cwhanse is that correct?

Yes, that is the intent.

So I'm guessing that this warning has been seen by only a small fraction of people that need to see it. I'm ok moving forward with the removal in 0.8 or pushing to 0.9.

The warning should have been raised whenever condition #2 above wasn't met; it looks to me that has been the case. If that hasn't been the case I would prefer to fix the warning and push the deprecation out to v0.9. pvlib-python has had that unadvertised default temperature model assignment for a long time.

The problem is that the only way to see this warning is to supply an invalid module_type or racking_model. That's because PVSystem._infer_temperature_model is called before the code above, and it looks up the default module_type and racking_model and successfully finds temperature coefficients.

I don't follow here - it looks to me that the warning should be raised if 1) temperature_model_parameters isn't specified, or 2) either module_type or racking_model are invalid. Maybe we're saying the same thing. _infer_temperature_model doesn't assign the default temperature model, that is done in the block of code that raises the warning.

The module_type and racking_model defaults prevent the warning from showing up in many use cases. If we change the defaults to None then the warning will be triggered. If we simultaneously remove the warning then code will break without users having ever seen the warning.

What is the expected behavior for PVSystem()?

The module_type and racking_model defaults prevent the warning from showing up in many use cases. If we change the defaults to None then the warning will be triggered. If we simultaneously remove the warning then code will break without users having ever seen the warning.

Aha. I see the problem now, thanks.  Perhaps remove the defaults in v0.8 and leave the warning as is?

Ok, I'll work on that.


Add agent data plane team as code owners.

This will auto-assign reviewers like in our other repositories.

:green_heart: Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Start Time: 2022-05-16T20:07:44.345+0000

Duration: 9 min 50 sec

Test stats :test_tube:

Test
Results

Failed
0

Passed
92

Skipped
1

Total
93

:robot: GitHub comments
To re-run your PR in the CI, just comment with:

/test : Re-trigger the build.


FFMPEG to v4l2loopback  Failed to allocate a buffer

Description
I am trying to direct an h264 DVR stream to /dev/video2 with the command below.
gst-launch-1.0 rtspsrc location="rtsp://admin:xxxxxxx@<IP_ADDRESS>:554/cam/realmonitor?channel=2&subtype=0" ! rtph264depay ! h264parse ! decodebin ! videoconvert ! video/x-raw,format=YUY2 ! tee ! v4l2sink device=/dev/video2
it runs and the RTSP sources directed to the dummy device /dev/video2 below is the outcome

Setting pipeline to PAUSED ...
Pipeline is live and does not need PREROLL ...
Progress: (open) Opening Stream
Progress: (connect) Connecting to rtsp://admin:xxxxx@<IP_ADDRESS>:554/cam/realmonitor?channel=2&subtype=0
Progress: (open) Retrieving server options
Progress: (open) Retrieving media info
Progress: (request) SETUP stream 0
Progress: (open) Opened Stream
Setting pipeline to PLAYING ...
New clock: GstSystemClock
Progress: (request) Sending PLAY request
Progress: (request) Sending PLAY request
Progress: (request) Sent PLAY request

I ran the detection command below to get detection results from the NVR
edgetpu_detect --source /dev/video2:YUY2:960x1080:30/1 --model /home/mendel/ssdlite_mobiledet_mask_edgetpu.tflite  --labels /home/mendel/mask_labels.txt --threshold .30 --max_area .1 --min_area .01
it works for a second ,display show the camera stream and  error code below occurs.

v4l2src device=/dev/video2 ! video/x-raw,format=YUY2,width=960,height=1080,framerate=30/1 ! glupload ! tee name=t
t. ! queue ! glsvgoverlaysink name=glsink
t. ! queue max-size-buffers=1 leaky=downstream ! glfilterbin filter=glbox ! video/x-raw,format=RGB,width=320,height=320 ! appsink name=appsink emit-signals=True max-buffers=1 drop=True sync=False
Error: gst-resource-error-quark: Failed to allocate a buffer (14): gstv4l2src.c(998): gst_v4l2src_create (): /GstPipeline:pipeline0/GstV4l2Src:v4l2src0

I tried playing with the buffers of the sudo modprobe v4l2loopback max_buffers=x but could no. success.
Can somebody tell me what am I doing wrong.?

Pipeline is live and does not need PREROLL ...
Progress: (open) Opening Stream
Progress: (connect) Connecting to rtsp://admin:xxxxx@<IP_ADDRESS>:554/cam/realmonitor?channel=2&subtype=0
Progress: (open) Retrieving server options
Progress: (open) Retrieving media info
Progress: (request) SETUP stream 0
Progress: (open) Opened Stream
Setting pipeline to PLAYING ...

Hi,man!
I have the same problem, how did you solve it?


Add a force option when the application already exists

If you run the command and the application or group already exists you get a message like this:
2015/12/08 11:29:23 Creating new job
2015/12/08 11:29:23 409 Conflict
It would be useful to have a force option to mimic a marathon PUT.

Fixed by 5bb4bab and 210be42


First commits

🗣 Description
These first commits modify cisagov/skeleton-ansible-role to install The Admiral. The changes group initial code, files, and documentation for the role so we can reuse them across deployments.
💭 Motivation and context
We want to use this role to ship the Admiral off to sea. See cisagov/cyhy_amis#639 for full details of the voyage.
🧪 Testing

I updated the default test scenario in 125e9eb. All 33 tests passed (in 19.34 seconds).

My testing environment was pyenv 2.3.15 running Python 3.9.13.

In addition, I successfully used the role to create the /var/cyhy/admiral directory on my local machine and verified that the correct Docker Compose files were in place.

✅ Pre-approval checklist

[x] This PR has an informative and human-readable title.
[x] Changes are limited to a single goal - eschew scope creep!

[x] All relevant type-of-change labels have been added.
[x] I have read the CONTRIBUTING document.
[x] These code changes follow cisagov code standards.
[x] All relevant repo and/or project documentation has been updated
to reflect the changes in this PR.
[x] Tests have been added and/or modified to cover the changes in this PR.
[x] All new and existing tests pass.

✅ Pre-merge checklist

[ ] Revert dependencies to default branches.
[ ] Finalize version.

✅ Post-merge checklist

[ ] Create a release.

This all looks great, aside from the minor things I noted, but before I approve this, I'd really like to see the "Testing" section mention that you successfully used this role to install the Admiral somewhere and that it functioned as expected.

Functions as expected!

@king-alexander - Reminder to turn on the branch protections before or after you merge this one (or ask me to do it, if you lack the necessary permissions).

@king-alexander Why are the molecule tests failing?

@king-alexander Why are the molecule tests failing?

@dav3r https://github.com/cisagov/skeleton-ansible-role/pull/139

@king-alexander Why are the molecule tests failing?

@dav3r cisagov/skeleton-ansible-role#139

@king-alexander Any updates here now that https://github.com/cisagov/skeleton-ansible-role/pull/139 has been merged?

Approval reaches a fever pitch!!!
Let's merge #9 before we merge this one.

I rebased now that #9 is merged. Note that I dropped the commits where I disable and reenable Amazon Linux 2023 now that the platform works just fine.

Rebase after latest pull request is merged, then send up flare 🎇

Rebase after latest pull request is merged, then send up flare 🎇

Flare burns brighter! 🎆

Rebase after latest pull request is merged, then send up flare 🎇

Flare burns brighter! 🎆 @dav3r @jsf9k @mcdonnnj @felddy


Android not tracking events, works for Ios

Describe the bug
Android is not tracking events when initialized. First I thought this was a setup issue, but noticed the same problem in the demo app. Works for ios.
To Reproduce
Install demoapp, set endpoint to localhost:3000,  setup nepsnowplow to check for events. No events displayed. For android, does show for ios
Expected behavior
Expect android to also display screen events. When the app is initialized al the events work for Ios but not for android. This same behaviour is also seen in the demo app.
Smartphone (please complete the following information):

Device: Multiple Android emulators and a samsung S9
OS: android studio 4.0.2
Version: @snowplow/react-native-tracker": "^0.1.1"
react native: 0.62.2

Here a link to the video showing the issue:
https://twitter.com/ChaffieRN/status/1318146130388148225?s=20

Hi @chazzaoui, thanks for the report.
I can't reproduce the issue, both Android and iOS are working fine from my side.
I am using a Snowplow Mini instance to test, however, which leads me to believe that the issue for you might be down to communicating with localhost. I know there can be fiddly things with permissions needed.
If that doesn't solve the problem it's worth testing using something like Snowplow Mini if possible, to see if it persists on an external endpoint.
Closing this issue as it seems not to be a bug in the tracker. Please do reach out again if you discover reason to believe otherwise though. :)

@colmsnowplow Thank you for the response.
This would explain why it does work on Ios. Will check the permissions settings.
Thank you!


improveClean expired TableStatsMeta.

Drop catalog and older version of drop database (before https://github.com/apache/doris/pull/39685), will not remove table stats object in memory. Need a background thread to clean the garbage.

run buildall

run buildall

run buildall

run buildall

run external


It is impossible to define a true Mealy machine

From my understanding, the current behavior of this library is that all transitions are assigned the same output symbol as their input symbol. The mathematical definition of a Mealy machine requires transitions to have separate inputs and outputs (See: wikipedia.) For example, a transition from state A to state B whose input is the symbol X must be able to output a different symbol Y when that transition occurs.
Would it be possible to add this capability to this library?

Nevermind


Reduced code duplication in dcdc code

One can argue if this is easier to read but for sure it is not having redundant code snippets inside dcdc_control / dcdc_test.
We could have factored out the common code between dcdc_control and dcdc_test into a separate function but not sure if this would not be too much as dcdc_test actually never gets called.

Will have a look into this later, as I'm currently working on the current control issue #50 again.

Cherry-picked the commit, resolved conflicts because of other changes on master branch and merged it to master. At the same time I reduced the test function a bit more, so there is almost no code duplication anymore :)


Clarify how :set affects local values of global-local options

Steps to reproduce
It's unclear to me whether :setting a global-local value sets both the local and global values or unsets the local value so the global value is used. Different tests indicate different things:
" Initialize the test.
setg autoread
setl noautoread

" Test what `:set` sets.
set autoread
setg noautoread
set autoread? " Value is `autoread`, indicating that the local value was set.

" Initialize the test
setg tagcase=followic
setl tagcase=ignore

" Test what `:set` sets.
set tagcase=ignore
setg tagcase=followic
set tagcase? " Value is `followic`, indicating `:set` unsets the local value.

Expected behaviour
Consistent behavior and/or clarification of semantics in docs. Is this a difference between number/boolean and string options?
Version of Vim
9.0.1664

Yes, case 1 as you expect. For case 2, I think this is again because you choose a global-local setting, and the value is unset to indicate that the global value will be use.  If you check with a true local option again, like tagfunc, it will behave again like case 1):
" Initialize
:setg tagfunc=setg |setl tagfunc=setl
" Test
set tagfunc=set | setg tagfunc=setg
:echo  &tagfunc
" value for the local option is used

are we fine to close?

@ddickstein is right. There's inconsistency between string and number/boolean options here.
That is, set makeprg=xxx is always equivalent to setg makeprg=xxx followed by setl makeprg= (which is kind of expected). But set undolevels=100 results in setg undolevels=100 followed by either setl undolevels=-123456 or setl undolevels=100 depending on whether local undolevels was set earlier or not.
To me it rather looks like a bug.

Right - I am specifically making a point about inconsistent behaviors between across global-local options. tagfunc, which is a buffer-local option, isn't applicable.


feat: add FastEmbed text embedding support

This commit includes changes made to add support for FastEmbed text embedding. We've added a new dependency 'fastembed' in our Cargo.toml. New error message has been added in 'error.rs' to handle any FastEmbed related errors. Created a new struct 'FastEmbed' under 'fastembed.rs' that utilizes the FastEmbed library for text embedding. Also, added FastEmbed related modules and updated embedding/mod.rs accordingly. Tests for FastEmbed have been included as well.

LGTM. probably worth having an example.


bug when  serve

Package version
4.1.0
Node.js and npm version
node v 10.17.0
npm 6.11.3
this error  show  when serve although it worked before
TypeError: this.app.with is not a function
1 BodyParserProvider._registerValidatorBindings
/home/mostafa/projects/hive-back/hive-logic-api/node_modules/@adonisjs/bodyparser/providers/BodyParserProvider.js:86
2 BodyParserProvider.boot
/home/mostafa/projects/hive-back/hive-logic-api/node_modules/@adonisjs/bodyparser/providers/BodyParserProvider.js:101
3 _.filter.map
/home/mostafa/projects/hive-back/hive-logic-api/node_modules/@adonisjs/fold/src/Registrar/index.js:147
4 arrayMap
/home/mostafa/projects/hive-back/hive-logic-api/node_modules/lodash/lodash.js:639
5 Function.map
/home/mostafa/projects/hive-back/hive-logic-api/node_modules/lodash/lodash.js:9554
6 interceptor
/home/mostafa/projects/hive-back/hive-logic-api/node_modules/lodash/lodash.js:16997
7 thru
/home/mostafa/projects/hive-back/hive-logic-api/node_modules/lodash/lodash.js:8795
8 anonymous
/home/mostafa/projects/hive-back/hive-logic-api/node_modules/lodash/lodash.js:4368
9 arrayReduce
/home/mostafa/projects/hive-back/hive-logic-api/node_modules/lodash/lodash.js:683
10 baseWrapperValue
/home/mostafa/projects/hive-back/hive-logic-api/node_modules/lodash/lodash.js:4367
Application crashed, make sure to kill all related running process, fix the issue and re-run the app

Hey @m-mgahed!
Could you share the version of all Adonis package? Seems that you are using an old version of Adonis with the new packages.

hey @RomainLanz !
sorry for late !
yes,u r right it seems that i use an old version of adonis
Thank you for your interest .


Realm.io conflict with AnyObject subscript

I'm about to implement Realm models in my Swift 2.0 app. However, once I pod install Realm. My AnyObject subscripts for my app will cause a compile error
"Cannot subscript a value of type 'AnyObject' with an index of type 'String'"
"Cannot subscript a value of type 'RLMProperty' with an index of type 'String'"
let outlet: AnyObject = (self.campaigns[indexPath.section]["surveys"]!![indexPath.row])["outlet"]!!
// Configure the cell...
campaignCell.outletID.text = outlet["code"] as? String
campaignCell.outletNameLabel.text = outlet["name"] as? String
//campaignCell.outletAddressLabel.text = outlet["outlet"]!!["address"] as? String
campaignCell.outletStatusLabel.text = (self.campaigns[indexPath.section]["surveys"]!![indexPath.row])["progress"]!!["name"] as? String

campaignCell.outletStatusLabel.textColor = UIColor.colorWithHexString(((self.campaigns[indexPath.section]["surveys"]!![indexPath.row])["progress"]!!["color"] as? String)!)

My AnyObject subscripts for my app will cause a compile error

There are no subscripts with Swift by default for AnyObject. So you would need to provide some further info, how you have made them possible in the first place.
It looks to me like you have defined a custom postfix operator !!, which force-unwraps the optional AnyObject argument and force-casts it to another subscript-able type [String : AnyObject]. I don't see how that should directly conflict with any definition given by Realm. Are any of the involved objects RLMObject instances? Do you access the object schema anywhere?

@happiehappie I noticed you posted this on StackOverflow. We would prefer to finish this conversation over there so that others can more easily benefit from the answer. As a result, I am going to close this issue for now.

I don't have enough reputation on StackOverflow so I can't post there. However the same thing happened to my too now. Everything worked fine when I used “import RealmSwift” then I “Cleaned Build Folder” and after that the issue acquired.
This is one line:
let title = obj[“title”] as? String
And it gives me error:
Cannot subscript a value of type 'AnyObject' with an index of type 'String'
I did not used pod to install Realm, I did it manually.
I get around this issue if I comment out import RealmSwift and then “clean my project”,
after that I uncomment it again and then build. It works again but every time I “Clean Build Folder” same error happens.


add hair pick emoji (U+1FAAE)

hello this is my first time doing anything with SVG in a while
I've tried to make some progress with #8 by creating this emote
I hope you like it!

Oops, I also started working on this one earlier today and didn't see your PR until after I finished my version. Hope you don't mind my PR #25, sorry about that

Oops, I also started working on this one earlier today and didn't see your PR until after I finished my version. Hope you don't mind my PR #25, sorry about that

that's totally fine, yours seems like a better fit anyway!
hope your emote makes it in


Better guidance for access options

Describe the solution you'd like
[A clear and concise description of what you want to happen.]
Provide pros and cons of each access option listed: https://github.com/Azure/secrets-store-csi-driver-provider-azure#provide-identity-to-access-key-vault
Anything else you would like to add:
[Miscellaneous information that will assist in solving the issue.]
Environment:

Secrets Store CSI Driver version: (use the image tag):
Azure Key Vault provider version: (use the image tag):
Kubernetes version: (use kubectl version):
Cluster type: (e.g. AKS, aks-engine, etc):

Add the details here: https://azure.github.io/secrets-store-csi-driver-provider-azure/configurations/identity-access-modes/

Hello @aramase, the above link is not working. It is throwing a 404

Hello @aramase, the above link is not working. It is throwing a 404. Can you please take a look. thanks.

Could you try https://azure.github.io/secrets-store-csi-driver-provider-azure/docs/configurations/identity-access-modes/

Hello @aramase, the above link is not working. It is throwing a 404. Can you please take a look. thanks.

Could you try https://azure.github.io/secrets-store-csi-driver-provider-azure/docs/configurations/identity-access-modes/

This link is working, thanks


Error while updating property 'accessibilityRole' of a view managed by:RCTView

Hi I am getting following error. PFA
Error while updating property 'accessibilityRole' of a view managed by:RCTView
null
Invalid accessibility role value:tab
React Native version:
React Native Environment Info:
System:
OS: macOS 10.15.2
CPU: (4) x64 Intel(R) Core(TM) i5-5350U CPU @ 1.80GHz
Memory: 53.47 MB / 8.00 GB
Shell: 5.7.1 - /bin/zsh
Binaries:
Node: 12.14.1 - ~/.nvm/versions/node/v12.14.1/bin/node
npm: 6.13.4 - ~/.nvm/versions/node/v12.14.1/bin/npm
Watchman: 4.9.0 - /usr/local/bin/watchman
SDKs:
iOS SDK:
Platforms: iOS 13.2, DriverKit 19.0, macOS 10.15, tvOS 13.2, watchOS 6.1
Android SDK:
API Levels: 28, 29
Build Tools: 28.0.3, 29.0.2
System Images: android-28 | Google APIs Intel x86 Atom_64, android-28 | Google Play Intel x86 Atom, android-29 | Google APIs Intel x86 Atom
IDEs:
Android Studio: 3.5 AI-191.8<IP_ADDRESS>10548
Xcode: 11.3.1/11C504 - /usr/bin/xcodebuild
npmPackages:
react: 16.6.3 => 16.6.3
react-native: ^0.59.10 => 0.59.10

+1

+1 same problem caused by createMaterialTopTabNavigator

same issue.  Just came out of nowhere two days ago

Same here. I just added react-native-gesture-handler:1.3.0 react-native-reanimated:1.2.0 and upgrade react-native-tab-view to 2.7.0 and this happen.

What's wrong with React Native? Out of blues, this error starts showing up? :(

It's really strange.  It's working on this snack https://snack.expo.io/@jessebrightman/tabs-error but same code is not working on my project. I am verifying dependencies and will report back.

BTW - my project is a bare project

I hadn't modified my project in a while, and now I just tried to run an "npx react-native run-android" and got this error. The only thing that has changed since then is that the react-native version has been updated. It looks like we're all at 0.59.

any luck on this issue?

no luck yet! but as a temporary solution you can use Tabs from native-base it is the only one working for me!

Hi everyone, I figured out with temporary solution actually. Here what is:
I set react-native-tab-view version 2.7.0 with hardcoded in package.json. Not "^2.7.0", because if you set like this it's downloading 2.13.0 from npm, which had actual problem.
react-native-gesture-handler version 1.3 and react-native-reanimated version 1.2 which re compatible with 2.7.0 because it's latest version before Android X version as this 3rd party libraries. So problem basically fixed.
By the way if we talk about why this error happening. It's because of in the latest version of react-native-tab-view TabHeader components are inheriting from TouchableFeedback and setting accessibilityRole as "tab" but none valid role in android native side. So this error happening. I can't go deep in library and fix it cause I don't had time that much currently. If any of contributors from this project tracking this issue. They can easily fix.
Best wishes.

Thanks @yadigarbz, that's fixed my problem. For beginnner users, remember you must run npm install after change the packages version on package.json.

@yadigarbz Thank you! That fixed it for me!


[ENG-14936] Added logic to publish jars via gradle to maven central

High level changes:

Added signing plugin in add signature to artifacts.
Generate javadocs jar files
Include sources, javadocs in published artifacts.
Use Publisher API from cental-sonartype to upload the artifact.
Published the signature used with following command.

gpg --keyserver keyserver.ubuntu.com --send-keys PUBLIC_KEY

Task linked: ENG-14936 LakeView SyncTool


Embedding videos into markdown or pages or blogs

🚀 Embeddable video
Since Markdown format doesn't yet support video format, It would be a really nice feature if Docusaurus could support embedding videos. Right now, I'm trying to embed a YouTube video to the homepage (index.js), but there isn't any straight-forward way of doing that as far as I've seen. I think this could be useful even in the Markdown files that are used for serving documentations.
Have you read the Contributing Guidelines on issues?
Yes
Motivation
You can use a short video in the home page for introduction or other promotional pitches. Sometimes a video of certain task is much easier to follow than reading through a lot of steps in a documentation. So, being able to embed a video would be a good addition to this tool.
Pitch
This feature could probably be somehow implemented if the following existing feature request is implemented which would embedding react components into markdown. I haven't searched yet, but I'm sure there are components available that can show video from an external source.
https://github.com/facebook/Docusaurus/issues/489
Not sure how this is going to work in other areas (i.e. pages, blog, etc.). If Docusaurus can provide a way of embedding video that can be used everywhere it would be really good.

this can be done easily if react component can be embedded in markdown.
The good news is this is super easy in v2, the bad news is we wont implement it in v1 for now due to architecture constraint.
i will be closing this issue since #489 has a similar nature
Sent with GitHawk

I stumble with this issue recently, if someone needs help to add a video try this: https://stackoverflow.com/a/69193176/5734097


Nethsm rest api update

This PR solves tasks from issue #229
Changes
Breaking changes

/keys POST: changed response
/config/tls/csr.pem PUT: changed to POST
PublicKey changed (#227)

Non-breaking changes

KeyMechanism extended
DecryptMode extended
KeyType extended

New endpoints

/keys/{KeyID}/restrictions/tags/{Tag} DELETE
/keys/{KeyID}/restrictions/tags/{Tag} PUT
/users/{UserID}/tags GET
/users/{UserID}/tags/{Tag} DELETE
/users/{UserID}/tags/{Tag} PUT
/config/tls/generate POST

Other

check whether the removal of "produces": ["application/x-pem-file"], affects the client -> Checked, it does affects the client. Thus the keys were manually added again.
check whether we can revert 5880e68, 365b918 -> Checked, no we can not. The client sends content-type application/json which is rejected by the server, as only application/x-pem-file is supported.

Checklist

[x] tested with Python3.9
[x] run make check or make fix for the formatting check
[ ] signed commits
[ ] updated documentation (e.g. parameter description, inline doc, docs.nitrokey)
[ ] added labels

Test Environment and Execution

OS: Fedora Linux 36
device's model:
device's firmware version:

The black code reformat I missed. Is reformatted now.


Migrate from search_results to result throughout

Also migrate DB contents. And variable names throughout.

Merged into master, closing


Declaring a function type prevents refinement invalidation

Flow version: all versions
Expected behavior
This code should not pass type check because id is not guaranteed to be a string:
const doSomething = (id: ?string) => {
  const bad: () => void = () => {id = null}
  if (id) {
    bad();
    (id: string);
  }
}

Actual behavior
It passes type check.
Removing the type annotation on const bad makes it error as expected; for example: https://flow.org/try/#0MYewdgzgLgBAJiAyiAtgUygCwJZgOYwC8MAFNnAFwwD80ATrngJREB8MA3gFAwyiSwARgEM4RUi0LsO5cWACuAG0UBfHjGwAzUuRbdevEXBJMA3Ot5lKMeozPq1KoA

Link to Try-Flow or Github repo: https://flow.org/try/#0MYewdgzgLgBAJiAyiAtgUygCwJZgOYwC8MAFNnAFwwD80ATrngJREB8MA3gFAwyiSwARgENKpFoXYA3EOSLi2nOcTABXADbqAvjxjYAZqXItuvXiLgkmAbl28yY+oxu6dWoA

This now errors.


Flutter iOS App Crashing When Adding Firebase Packages

The log files were too long so GitHub said it exceeded the character limit of 65536 characters so I made it into a markdown file and uploaded it instead.
GitHub also doesn't let you upload .md files so I uploaded it to Google Drive instead:
https://drive.google.com/file/d/1KyHnE9RM4lCdWe6RF7Xvz1eLR3Cin-3_/view?usp=sharing

@HadyMash
Firebase related issues are tracked here: https://github.com/FirebaseExtended/flutterfire/issues
Please open this issue there by providing all required details.
Closing from here.


datasette publish option for setting plugin configuration secrets

Follow-on from #538 - the datasette publish command needs a way of passing secrets which will be made available to plugin configuration but will not be exposed in /-/metadata.json.

Potential design:
$ datasette publish --plugin-secret datasette-auth-github:client_id xxx

This would populate the following in metadata.json:
{
    "plugins": {
        "datasette-auth-github": {
            "client_id": {"$env": "DATASETTE_AUTH_GITHUB_CLIENT_ID"}
        }
    }
}

And would ensure that the environment variable DATASETTE_AUTH_GITHUB_CLIENT_ID is set to the correct value.

As soon as I have this working I can use it to ship a live demo of https://github.com/simonw/datasette-auth-github

    $ datasette publish now fixtures.db \
        --branch=master \
        --alias datasette-auth-demo \
        --install=datasette-auth-github \
        --plugin-secret datasette-auth-github client_id 86e397f7fd7a54d26a3a \
        --plugin-secret datasette-auth-github client_secret ...

https://datasette-auth-demo.now.sh/


cost jumps after some epochs

this happened in different machines, at different points during training. Couldn't find where this is happening in the source code.
Can't share the data :(
TRAINING MODEL
Read 563738072 lines.
Initializing parameters...Using random seed<PHONE_NUMBER>
done.
vector size: 600
vocab size: 85748
x_max: 100
alpha: 0.75
10/27/21 - 03:59.19PM, iter: 1, cost: 0.071133
10/27/21 - 04:13.09PM, iter: 2, cost: 0.0551224
10/27/21 - 04:27.28PM, iter: 3, cost: 0.0505688
10/27/21 - 04:41.43PM, iter: 4, cost: 0.0454685
10/27/21 - 04:55.38PM, iter: 5, cost: 0.0416584
10/27/21 - 05:09.45PM, iter: 6, cost: 0.0392608
10/27/21 - 05:23.49PM, iter: 7, cost: 0.0376295
10/27/21 - 05:37.49PM, iter: 8, cost: 0.0365679
10/27/21 - 05:51.59PM, iter: 9, cost: 0.0359734
10/27/21 - 06:05.49PM, iter: 10, cost: 34.4493

I've made some changes to deal with this issue during training:
TRAINING MODEL
Read 455065004 lines.
Initializing parameters...Using random seed<PHONE_NUMBER>
done.
vector size: 600
vocab size: 85748
x_max: 100
alpha: 0.75
epochs: 40
eta: 0.05
11/03/21 - 07:39.33PM, iter: 1, cost: 0.0823551
11/03/21 - 07:56.42PM, iter: 2, cost: 0.064717
11/03/21 - 08:13.47PM, iter: 3, cost: 0.0599455
11/03/21 - 08:30.48PM, iter: 4, cost: 0.0536976
11/03/21 - 08:47.54PM, iter: 5, cost: 0.0487482
11/03/21 - 09:05.05PM, iter: 6, cost: 0.0456012
11/03/21 - 09:22.10PM, iter: 7, cost: 0.0435627
11/03/21 - 09:39.50PM, iter: 8, cost: 0.042235
11/03/21 - 09:56.59PM, iter: 9, cost: 43.8812
11/03/21 - 09:56.59PM cost increased, restoring last training checkpoint and lowering eta from 0.05 to 0.025
11/03/21 - 10:14.01PM, iter: 9, cost: 0.0361162
11/03/21 - 10:31.02PM, iter: 10, cost: 0.033401
11/03/21 - 10:48.04PM, iter: 11, cost: 0.0325761
11/03/21 - 11:05.09PM, iter: 12, cost: 0.0320624
I'm saving grad and weights each epoch, whenever cost increases I restore the last checkpoint and decrease learning rate by a decay rate. Seems to work.

another change I've made: changed from double to single precision resulted in a major speed up.
each epoch took 19, now it's about 9min on the same machine.

also rewrote it in C++/STL to get rid of malloc's and possible memory leaks.

pushed my changes to my own cloned repo https://github.com/rpvelloso/GloVe

vocab count & glove rewritten in C++ (will rewrite other modules later);
glove runs twice as fast with fp16 math.

closing.


Just hangs on test or run (Xcode 7 beta 6)

Let this run for 10 minutes...never returns or prints anything:
$ snapshot test --verbose --nobuild

$ snapshot --version
snapshot 0.9.2

Sorry, snapshot doesn't yet support the Xcode Beta, but this will soon change https://github.com/KrauseFx/snapshot#note-support-for-ui-tests-with-xcode-7
I'll close this issue as duplicate of https://github.com/KrauseFx/snapshot/issues/180
Thanks for reporting :+1:

Is there a working beta branch we can get started with? Doesn't seem worthwhile to set up the UI automation script for snapshot if we're going to have to redo them to use UI Testing shortly.

Yes, that's true. If you're just getting started, please wait a few more weeks before setting up snapshot


MAINT: 1.3.0rc2 & backports

Backport PR to maintenance/1.3.x including:

bump to 1.3.0rc2 unreleased--we need an rc2 for wheels because of the OpenBLAS SkylakeX AVX fix demonstrated in #10145
backport of two PRs: #10135 and #10116
release notes PR list updated to include the above two PRs

Appveyor seems to be queued to oblivion at the moment--I don't even see a job running anywhere when I click through.
Anyway, Appveyor only tests Windows 64bit Full with Python 3.7 these days, which is redundant for all practical purposes with a matching entry in the Azure matrix, so I'm going to merge.


Fix Javadoc errors on JDK > 11

On more modern JDKs (e.g., Java17) the build breaks due to insufficient Javadoc coverage.
However, in the build we disable Javadoc creation (see here) but we should probably add proper Javadoc comments and then re-enable the doc gen (at least on Java17 only maybe).

I took some time to look into this. The only errors I ended up seeing were from the generated-sources. Basically, the exclusion here isn't working. And I couldn't get it to work.

OK, I think we can close this one now. That said, when working on code, it would be good to cleanup javadoc errors on files that you touch (assuming they're not generated files that is).


Use more suitable tokio Command functions

Motivation
We don't always need the output. Also, for kind delete that gets called on drop, we shouldn't mess with stdout/stderr at all, because it can hang waiting on a buffer flush that never happens, because the tokio runtime is already shutting down.
Proposal
Call more suitable methods
Test Plan
Tested running e2e tests with Kubernetes

Current dependencies on/for this PR:

main

PR #1319   👈

PR #1317

This stack of pull requests is managed by Graphite.


.NET 8: Repositories dependency info re-work

Describe the Problem
Source-build works today by building a repository, gathering the versions of the outputs, and creating a property file with those versions. This property file is then fed to downstream repositories, which import it after their eng/Versions.props. The resulting behavior is that the downstream repo overrides all dependency versions specified in eng/Versions.props with the versions built from source. This behavior is not the same as the Maestro dependency-flow based approach. Maestro only updates properties for dependencies that are specified in eng/Version.Details.xml.
This causes the following difference: Say that dotnet/aspnetcore has a Microsoft.Net.Compilers.Toolset dependency. It codes a property for that dependency's version in eng/Versions.props as MicrosoftNetCompilersToolsetVersion, with an older version of the package.

When building via source-build, roslyn builds first, and aspnetcore will pick up the new version of Microsoft.Net.Compilers.Toolset, even though it doesn't want to.
When building officially, the non-latest version will be used.

This difference tends to cause build breaks in source-build. The version bump may be significant and require repo reaction. This is not ideal and not sustainable.
One option would be to only override those versions that are specified in eng/Version.Details.xml. This would more closely align the source-build and current official builds. The huge downside is that this will cause an explosion of ref packs. And in some cases, we would be building against old versions but actually executing against newer ones. Non-ideal.
In summary, the goals are:

Reduce source-build build breaks
Avoid a large increase in ref packs.
Ensure that it is possible to freeze on old versions of a specific component if absolutely necessary

Describe the Solution
The solution is for repositories to:

[ ] Track dependencies that come from within repos in source-build accurately within eng/Version.Details.xml files.
[ ] Upgrade dependencies regularly via dependency flow mechanisms, or pin dependencies that should stay the same, with justification.
[ ] Source-build switches to only overriding unpinned dependency versions specified in eng/Version.Details.xml.

Additional Context
Sub-issues:

https://github.com/dotnet/source-build/issues/2980
https://github.com/dotnet/source-build/issues/2981
https://github.com/dotnet/source-build/issues/2982

/cc @MichaelSimons @tkapin @crummel

This work has been completed.


How to train SENet using basic FasterRCNN?

Hello @hellock ,
I'd like to train (ResNet + SENet) as backbone and use FasterRCNN to do object detection task using the ImageNet pretrained model. However, when I simply add SENet in the ResNet residual block(after conv3) and train in Pascal VOC0712 dataset, the performance actually goes down a little bit which is weird. I heard someone said adding a SE-Layer will destroy the pretrain weights of ImageNet so results in a decrease of mAP. Is there any training skill or method I can use to improve the performance?  (besides, GCNet seems added at the same localtion as SENet, but mAP can boost up around 1%, but why SENet won't work?) Many Many Thanks! Hope you can comment on it :)

SENet requires pre-trained backbone. You need to implement SENet first by adding the module in mmdet.models.backbones like resnet.py. Then you need to prepare a pre-trained SENet. GCNet does not need to pertain GCBlock, it only requires pre-trained ResNet.

Thanks very much!


Get extractions for additional patches for spatial inference (landcover task)

This issue is about defining the location of the patches themselves. Extracting data happens in another issue.

@cbutsko can you give an update? Is this ongoing/needed?

Need to query RDM for available crop type datasets and define patch locations based on those.

29 new patches are defined here: /vitodata/worldcereal/presto/testpatches/inference_croptype/croptype_inference_patches.gpkg
Each patch has the following attributes:

sample_id (string): a short description of patch, now roughly constructed as {country}_{crop}
GT_available (bool): indicates whether RDM contains reference data for the patch
valid_time (date): if patch has GT available, then valid_date is taken from available data; if not - an educated guess based on targeted search is made; for those patches that don't have GT data available, 2021 is always chosen (for no particular reason)
extract (int): ancillary attribute indicating whether the patch should be extracted (>0) or not (==0)

They are created based on combination of aggregated SPAM maps and existing RDM statistics (described in more detailes in issue 56)
15 of these patches contain at least some corresponding GT data in the RDM (sometimes as few as just 4-5 points). Other 14 patches are selected based on expected density of a crop in aggregated SPAM map.
Focus is made on crops that are the first priority for WorldCereal: maize, soybean, rapeseed, sunflower, millet, sorghum, wheat, barley.


Deploy ignores azureFunctions.deploySubpath (Azure Functions extension v1.13.2)

Operationing system: MacOS 14.3
VS Code version: 1.86.0
Project: C# Net6.0
Right clicking on an Azure Function and selecting deploy will build the app successfully and then proceed to create the package file. In the Azure Functions Output, all files from the project root level are included in the zip and deployed to Azure. The contents of /site/wwwroot then contains root level files of the project and subfolders, resulting in it not finding the correct files to start the app. No functions are found.
Workaround: Manually zip up the publish folder and send using the CLI publish command.
The issue is not present after reverting to version 1.12.4. I haven't tried any other versions of 1.13.

I had the same issue on Windows / reverting to 1.12.4 also resolved for me.
Operationing system: Windows 11 Enterprise v10.0.22621
VS Code version: 1.85.1
Project: PowerShell Core 7.2

Same problem on windows here. I solved it by downgrading the Azure Functions extension from 1.13.2 to 1.13.1
Version: 1.87.0-insider (user setup)
Electron: 27.2.3
ElectronBuildId: 26495564
Chromium: 118.0.5993.159
Node.js: 18.17.1
V8: <IP_ADDRESS>-electron.0
OS: Windows_NT x64 10.0.22631

Related to https://github.com/microsoft/vscode-azurefunctions/issues/3969
Sorry for the break, folks. I have a fix that is merged and we should be releasing it later today.

Wow, this is amazing. I spent the better half of this morning trying to figure this out, so cool to find this was a really immediate thing with a quick fix. Thanks!

Awesome!

I can confirm it's now working as expected. Thanks again for the quick response! 🚀


[NCL-3186] Add subcommand to close milestone

I have to admit that I couldn't properly test it on Stage environment, looks like Maitai got tired of my requests to start a new release process.

I was finally able to verify that it works on Stage environment. Merging it for release.


[AKS] Fix the permission issue in aks install-connector

This checklist is used to make sure that common guidelines for a pull request are followed.

[ ] The PR has modified HISTORY.rst describing any customer-facing, functional changes. Note that this does not include changes only to help content. (see Modifying change log).

[ ] I adhere to the Command Guidelines.

Fix the permission issue in aks install-connector when --aci-resource-group is not specified.

View a preview at https://prompt.ws/r/Azure/azure-cli/6090
This is an experimental preview for @microsoft users.

@mboersma can you take a look?


Typo Uknown in network/resource-manager/Microsoft.Network/networkWatcher.json

Should be "Unknown"
Found in a few API versions https://github.com/Azure/azure-rest-api-specs/search?q=Uknown&type=Code

Fixed by @irrogozh in the current version


Region mismatch between labs

pre-requisites asks to set region to export AWS_DEFAULT_REGION=eu-central-1
while kops tutorial uses us-east-1
kops create cluster
--name cluster.kubernetes-aws.io
--zones us-east-1d,us-east-1e
--state s3://kubernetes-aws-io
--yes
Is this intentional?

This is fixed. I am going through the cluster install steps, the PR just hasn't been added yet.

Fixed in https://github.com/arun-gupta/kubernetes-aws-workshop/pull/112


Some conversions to use PacketBufferHandle

Problem
Code should use PacketBufferHandle rather than PacketBuffer *.
Summary of Changes
This PR focuses on converting various message-received functions'
arguments from PacketBuffer* to PacketBufferHandle, notably:

Rename PacketBufferHandle::Clone() to Retain() for clarity
Base::HandleMessageReceived() and associated types and impls
IPEndPointBasis::HandleDataReceived() and impls
Device::OnMessageReceived()
ChipDeviceController::OnMessage()
SecureSessionMgrDelegate::OnMessageReceived()
BleEndPoint::Receive() and related
SecurePairingSession::HandlePeerMessage()
RendezvousServer::OnRendezvousMessageReceived()
chip-tool command functions
ExchangeContext receive functions

Some arguments and variables are named with _ForNow to indicate that
they will be replaced in a future conversion step.
Part of issue #2707 - Figure out a way to express PacketBuffer ownership in the type system

What caused the size to increase?

What caused the size to increase?

Mostly passing PacketBufferHandles, at about 12 bytes each pair on ARM, plus destructing for 8. Maybe a later pass could change some to forwarding.


Feature request: Workspaces

I currently switch to arch + bspwm and happy with the way bspwm manages workspace. With windows desktop, there always lag/unstable and slow animation when switching desktop.
Is there any plan for yatta to support a virtual workspace?

Hey @xquangdang! I don't use workspaces myself, but I would definitely welcome a PR from someone who wants to try implementing virtual workspaces for yatta!

@xquangdang Please check out https://github.com/LGUG2Z/komorebi which has support for workspaces 🎉


Support logging-based progress meter

Codecov Report

Merging #63 into master will increase coverage by 0.72%.
The diff coverage is 97.4%.

@@            Coverage Diff             @@
##           master      #63      +/-   ##
==========================================
+ Coverage   84.09%   84.81%   +0.72%
==========================================
  Files          16       17       +1
  Lines        1012     1060      +48
==========================================
+ Hits          851      899      +48
  Misses        161      161

Impacted Files
Coverage Δ

src/Transducers.jl
100% <ø> (ø)
:arrow_up:

src/dreduce.jl
100% <100%> (ø)
:arrow_up:

src/progress.jl
97.33% <97.33%> (ø)

src/simd.jl
75% <0%> (-9.38%)
:arrow_down:

src/processes.jl
91.11% <0%> (-1.49%)
:arrow_down:

src/core.jl
68.21% <0%> (-0.18%)
:arrow_down:

src/show.jl
94.87% <0%> (-0.05%)
:arrow_down:

src/library.jl
93.22% <0%> (+0.24%)
:arrow_up:

... and 2 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1f56a5c...6c04706. Read the comment docs.


[BEAM-410] Sort PriorityQueue with explicit comparator

This changes the PriorityQueue<QuantileBuffer> to sort with explicit comparator rather then overloading QuantileBuffer.compareTo(). This avoids potential issues around compareTo() returning 0 for values that aren't equal. It also fixes FindBugs warnings about compareTo() being overloaded without also overloading equals() and removes the FindBugs filter.

Follow this checklist to help us incorporate your contribution quickly and easily:

[X] Make sure there is a JIRA issue filed for the change (usually before you start working on it).  Trivial changes like typos do not require a JIRA issue.  Your pull request should address just this issue, without pulling in other changes.
[X] Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue.

[X] Run mvn clean verify to make sure basic checks pass. A more thorough check will be performed on your pull request automatically.

Gradle failure was a known flake. I will try to spend a minute and sickbay these known issues. I filed them a bit ago to see if natural owners wanted to fix.

run gradle java precommit

run java gradle precommit

retest this please

run python precommit

run java gradle precommit

run java precommit

Filed https://issues.apache.org/jira/browse/BEAM-3667 for the flake

@kennknowles It is passing now, PTAL


Explicitly set CELERY_BROKER_CONNECTION_RETRY_ON_STARTUP

Celery logs a warning to the console if this setting is not explicitly configured. See https://docs.celeryq.dev/en/stable/userguide/configuration.html#broker-connection-retry and https://docs.celeryq.dev/en/stable/userguide/configuration.html#broker-connection-retry-on-startup.

CI failures are unrelated to this PR.


Investigate Moving to Lucene.net 4.8 package.

This issue tracks the investigation for moving to the lucene 4.8 package, currently in beta (http://code972.com/blog/2016/07/98-lucene-net-4-8-is-in-beta-and-we-need-your-help).
Related repositories and branches:
https://github.com/ryuyu/azureDirectory/tree/update-lucene-net-48
https://github.com/NuGet/NuGet.Services.Metadata/tree/ryuyu-experimental-lucene4

Moving to backlog for now
Lucene 4.8 package is still in beta and missing some APIs.
This change would also require updating the azureDirectory project to 4.8 as well.
Status:
Basic end to end for search is working.
Tests are about 40% broken.

Conclusion from the POC: not much was gained functionality wise. With a change of this magnitude we might as well move to Azure Search.


 Code recycle of Jason's browser sim window and purge of content. Bare-bones summary page copied.
TODO: Fill in browser sim with LFI content, replace multiple choice questions with relevant content, and fill in the correct answer summary page with educational content.

Finished TODO list from above, ready to ship out as a functional first draft


Use injected logger directly in email sender classes

This pull request changes the email sender classes to use the injected logger directly in their methods.

@ardalis mentions wanting to use primary constructor parameters only to initialize fields in this blog post. I believe we would want to keep the code the way it was as the parameters are mutable while the private readonly fields are not.
https://blog.nimblepros.com/blogs/where-csharp-primary-constructors-make-sense/

@ardalis Branch conflict is resolved

I don't think we need this in its current state so closing.


Staging into master

GitHub Issue
Staging into master

Looks good -- this merges in the abi update and the CI updates? Those were the ones that seemed the most apparent to me @alexkeating

Yes


[GHSA-xpp6-8r3j-ww43] Undertow Denial of Service vulnerability

Updates

Affected products
CVSS v3
References

Comments
The CVE has been fixed with undertow version 2.3.15.Final. See the vendor ticket for reference: https://issues.redhat.com/browse/UNDERTOW-2413

Going off of that issue it looks like a fix also got back ported to 2.2.34.Final as well. I'll go ahead and add a second version range for that. Thank you much 👍


Removed inconsistent whitespaces from shipmenteventtypecodes.csv

Came across some inconsistent whitespaces that I quickly cleaned up.

Thanks :)


ERROR: Extension with name 'nexusPublishing' does not exist.

I am trying to use the plugin to deploy to maven central (now that jcenter is gone).
I am getting the following error on build:
* Where:
Build file '/Volumes/case_sensitive/github/jasync-sql/build.gradle.kts' line: 142

* What went wrong:
Extension with name 'nexusPublishing' does not exist. Currently registered extension names: [ext, kotlin, kotlinTestRegistry, defaultArtifacts, sourceSets, reporting, java, javaInstalls, javaToolchains, publishing, jacoco, ktlint]

To reproduce it I upload the code with changes to a branch: https://github.com/jasync-sql/jasync-sql/tree/publish-plugin
Thanks in advance!

Move:
    nexusPublishing {
            repositories {
                sonatype()
            }
    }

from the allprojects {} block to the root project.

Thanks, that worked! (I think I tried it initially and it didn't, but probably my mistake).
I still have a problem in the repo upload. I think for some reason the version is not configured correctly (shows as unspecified)

I moved the version to the all project section and it looks better.
I still have an issue with signing the artifacts. Should I do it with another plugin?
I saw issue #85 which hints I should, but the docs don't explain how to integrate it.
Another plugin I saw is much more specific about how to do that: https://github.com/vanniktech/gradle-maven-publish-plugin#signing
I think I figured out I should use the signing plugin, so I will try that. But I think it will be nice if this plugin will deal with that or explain it in the docs.


Mothur MiSeq SOP: add extra background information about mock communities

Based on this feedback we received, I added some more background information about the rationale behind sequencing a mock community.
Thanks anonymous user for your constructive feedback!

Cool, thanks.


Pipeline output documentation

We will need to properly document/explain all of the outputs generated by the pipeline along with some nice plots and figures:
https://github.com/nf-core/atacseq/blob/dev/docs/output.md

This was initially added here https://github.com/nf-core/viralrecon/pull/48

Hi @drpatelh
I have made little changes here and there and will create a PR soon.
Questions that came up in usage.md:
Would it be possible to add a sentence to --amplicon_bed and --amplicon_fasta to say what it is needed for? Why is a bed file needed if we map the reads any way? Why is a fasta file needed if we assemble anyways?
Why are VarScan2 and iVar used for variant calling of reads against the reference genome, and Minimap2, seqwish, vg for variant calling of de-novo assemblies against the reference genome? Are the latter ones better suited for genome vs. genome? And why is specifically vg failing? Does --run_vg run specifically vg, or Minimap2 and seqwish as well? (I obviously don't know these tools yet and don't know about the concept of a variant graph yet)
Why is especially minia failing and hence not in the defaults for --assemblers?
Questions that came up in output.md:
Why are you using different trimming tools? fastp for general adapter trimming, iVar trim before variant calling, Cutadapt before de-novo assembly.
Best
Katrin

Docs are looking nice now as of https://github.com/nf-core/viralrecon/pull/103