Schema update and migrations

[x] Test the new schema upgrade feature and make sure it works properly.
[ ] Test the schema migrate function.
[ ]  Implement migrations in packages.

The auto update of the schema was not working fine, I fixed it here and fixed the test. https://github.com/threefoldtech/jumpscaleX_core/commit/60058cd875705c67c4fa4797feeb010b6f310d48

Added a new function to be able to migrate objects from one model to another, and added a test for it. https://github.com/threefoldtech/jumpscaleX_core/commit/860129720fda8a0ed678f00c67ed410639922c64

Both shema auotupdate, and the migrate function don't handle sub objects, these objects follow a different path. I investigated a bit but still didn't get to the bottom of things. I am pausing working on it now since it's moved to 10.3


Fix error handling when no features are found and remove force casting

Ensures that the application properly handles cases where no features are found, preventing silent failures.

Removes the use of force casting, improving code safety and reliability.

Could this be merged?

Yes


Week 2 Stage Minor Lagspike

In the Week 2 stage, every time a lightning flash happens, it creates a small lagspike which causes the player to miss a few notes. You can tell why that would be annoying
Video:
https://user-images.githubusercontent.com/77080832/185821804-6c93692c-0a1e-42be-ad3c-4cd4013dbbf2.mov

Can you update to the latest commit from the actions page & recreate the bug?
If so, can you show me the output logs?

ok


Motion Recognition using Heatmap

ML-Crate Repository (Proposing new issue)
:red_circle: Project Title : Motion Recognition using Heatmap
:red_circle: Aim : This project will identify the motions from the given heatmaps.
:red_circle: Dataset : https://www.kaggle.com/rupakroy/motion-heatmap-opencv
:red_circle: Approach : Try to use 3-4 algorithms to implement the models and compare all the algorithms to find out the best fitted algorithm for the model by checking the accuracy scores. Also do not forget to do a exploratory data analysis before creating any model.
Hello, ML-Crate contributors, this issue is only for the contribution purposes and allocated only to the participants of SWOC 2.0 Open Source Program and JWOC '22 Open Source Program.

📍 Follow the Guidelines to Contribute in the Project :

You need to create a separate folder named as the Project Title.
Inside that folder, there will be four main components.

Images - To store the required images.
Dataset - To store the dataset or, information/source about the dataset.
Model - To store the machine learning model you've created using the dataset.
requirements.txt - This file will contain the required packages/libraries to run the project in other machines.

Inside the Model folder, the README.md file must be filled up properly, with proper visualizations and conclusions.

:red_circle::yellow_circle: Points to Note :

The issues will be assigned on a first come first serve basis, 1 Issue == 1 PR.
"Issue Title" and "PR Title should be the same. Include issue number along with it.
Follow Contributing Guidelines & Code of Conduct before start Contributing.
This issue is only for 'SWOC' and 'JWOC' contributors of 'ML-Crate' project.

:white_check_mark: To be Mentioned while taking the issue :

Full name :
GitHub Profile Link :
Participant ID :
Approach for this Project :
What is your participant role?

[ ] SWOC 2.0 Participant.
[ ] JWOC 2022 Participant.
[ ] Contributor

Happy Contributing 🚀
All the best. Enjoy your open source journey ahead. 😎

Issue has been un-assigned from you due to inactivity.
@Komalkale25

hey,
Full name : Prakhar Chaubey
GitHub Profile Link : https://github.com/pieby2
Participant ID : NA
Approach for this Project : I would Like to contribute for this project
I will try to use different Algorithms with great accuracy to Analyze the Results
participant role : Contributor

Are you a participant of KWOC 2023?
@pieby2

yes i am a participant of KWOC 2023

Issue assigned to you @pieby2. You can start working on it.

hey,
Full name : Keshav Sharma
participant role : Contributor

Please mention your approach for solving this issue.
@keshav1441


Observation vs classification vs identification vs annotation

I'm still wondering if "observations" (see table) is the best term to use for annotations/observations/classifications/identifications. It is especially confusing when compared to Darwin Core/GBIF data, where observations means "observations of species". I think we've had this discussion before, but I can't find it in the issues. So, with this issue I want to open that discussion or at least document the decision.
Observations

Good: current situation. Conceptually, the animal observations are Darwin Core observations
Bad: does not only contain animal observations (but also blanks, vehicles, etc.) which makes it confusing with Darwin Core observations. Also, an animal recognized by a machine is to my knowledge not what is understood by a Darwin Core MachineObservation

Terms (current situation):
observations.csv
Table with observations based on the multimedia files.

observation_id
observation_type: animal/human/vehicle/empty/undefined/unclassified
classification_method: human/machine
classified_by
classification_timestamp
classification_confidence

~Classifications~

Good: we already have terms classified_by, etc.
Bad: can be easily confused with taxonomical classification

Terms (* indicates changes):
classifications.csv*
Table with classifications based on the multimedia files.*

classification_id*
classification_type*: animal/human/vehicle/empty/undefined/unclassified
classification_method: human/machine
classified_by
classification_timestamp
classification_confidence

Identifications

Good: ...
Bad: I think this suffers the same problem as observations, as in that it is too close to Darwin Core animal identifications. I'm also not sure if "identifications" are a term used for marking something as "blank"

Terms (* indicates changes):
identifications.csv*
Table with identifications based on the multimedia files.*

identification_id*
identification_type*: animal/human/vehicle/empty/undefined/unclassified
identification_method*: human/machine
identified_by*
identification_timestamp*
identification_confidence*

Annotations

Good: pretty broad term, so can apply to animal or blank annotations. Not used in Darwin Core.
Bad: maybe the term is too broad?

Terms (* indicates changes):
annotations.csv*
Table with annotations based on the multimedia files.*

annotation_id*
annotation_type*: animal/human/vehicle/empty/undefined/unclassified
annotation_method*: human/machine
annotated_by*
annotation_timestamp*
annotation_confidence*

Feedback welcome (cc @jimcasaer @yliefting @ben-norton @timrobertson100 @kbubnicki @tucotuco)

If it helps, a dwc:MachineObservation is a record whose ultimate source was something recorded by a Machine, this includes camera-trap based records as well as records based on photos taken by a human. It would apply in all cases where dc:type is one of StillImage, MovingImage, Sound. It has nothing to do with intention.

Classifications is out: too confusing

I understand the dilemma, as the table is effectively mixing two distinct things

metadata about how the image came to be (triggering, whether it was part of diagnostics etc)
metadata about organisms detected on the image including behaviour, sex, life stage, species identification and how the identification was made (i.e. "classic" DwC Occurrence records)

I don't know if this is in scope, but I wonder if it makes sense to split this into separate tables of ImageAnnotations and SpeciesObservations? As a general rule, I favor tabular designs where each record is an instance of the same thing to avoid having overly general row types.

@timrobertson100 triggering itself is now out, it will be part of media (#163), but diagnostics is not. We could investigate if splitting those image vs species annotations helps our case (@ben-norton @kbubnicki). See #177

If splitting doesn't fit the usage pattern (e.g. in the tools that will produce these) then I think I'd probably go with "observations" or "annotations". "identification" is something I'd consider narrower (i.e. only the species identification) than the rows actually contain.

Yeah, identification also seems to imply that non-consensus identifications for the same animal are allowed, but I think we want to keep that out of scope. @kbubnicki @ben-norton agree?

I would stay with "observations".
As for the idea of  splitting -> https://github.com/tdwg/camtrap-dp/issues/177#issuecomment-981673734

I think observation would work perfectly well for an empty image or observation of a vehicle, but I see the problem that Darwin Core/GBIF use it only for animals (and plants I assume).

But in the end only "observations" of animals will be exported to GBIF / converted to DC so maybe it is not a real problem?


Number of Submatrices That Sum to Target

Problem Link
https://leetcode.com/problems/number-of-submatrices-that-sum-to-target/
Coding platform
Leetcode
Programming language

[ ] C
[ ] C++
[ ] Java
[ ] Python

Additional context (OPTIONAL)
I want to solve it in Java

I would like to solve this in C++

Sure @Amit366 Go for it.


HTTP2: Always apply the graceful shutdown timeout if configured

Motivation:
Http2ConnectionHandler (and sub-classes) allow to configure a graceful shutdown timeout but only apply it if there is at least one active stream. We should always apply the timeout.
Modifications:

Always apply the timeout if one is configured
Add unit test

Result:
Always respect gracefulShutdownTimeoutMillis

@ejona86 PTAL again as I noticed there is also another place where we should apply a timeout.

These two new cases would probably benefit from using a separate timeout, since they should be much shorter periods of time whereas the normal graceful timeout could be an hour without being that big of a deal. But this is good for now.

@ejona86 i can add another timeout just wanted to keep it simple for now... let me know

@ejona86 let me just merge this for now and we can do another followup if needed.

I was fine leaving it as-is at this point.


[multistage] support sort push-down

This replaces #9507
Review Notes

!!NOTE!!: there is a v1 change in this PR, if SERVER_RETURN_FINAL_RESULT is set, the server will now return the "proper" columns, ordered by the query projection instead of the internal format. You can see this change in the files for *CombineOperator and SelectionOperatorService
ImmutableSortExchangeCopyRule.java is a generated file that I'm checking in. I generated it within the Calcite code base and ran ./gradlew generateSources and copied the contents over to Pinot. We could generate it as part of Pinot build, but that would require pulling in extra dependencies to do the codegen and add that to our build, and this file should change extremely infrequently.
The "main" part of the change is the introduction of PinotSortExchangeCopyRule, which simply copies a Sort past an Exchange (dropping the offset, and setting the limit to limit + offset). This was inspired by the implementation of https://github.com/apache/calcite/blob/406c913b808b3234464d8c81d7352c4040dd281a/core/src/main/java/org/apache/calcite/rel/rules/SortJoinCopyRule.java

What
This PR supports SORT operator push-down. For example, SELECT * FROM basic ORDER BY col1 DESC LIMIT 2 OFFSET 1 will now generate the following calcite logical plan:
LogicalSort(sort0=[$2], dir0=[DESC], offset=[1], fetch=[2])
  LogicalSortExchange(distribution=[hash], collation=[[2 DESC]])
    LogicalSort(sort0=[$2], dir0=[DESC], fetch=[+(2, 1)])
      LogicalTableScan(table=[[basic_order_by_basic]])

which generates this pinot query plan:
[0]@localhost:50762 MAIL_RECEIVE(RANDOM_DISTRIBUTED)
├── [1]@localhost:50761 MAIL_SEND(RANDOM_DISTRIBUTED)->{[0]@localhost:50762} (Subtree Omitted)
└── [1]@localhost:50760 MAIL_SEND(RANDOM_DISTRIBUTED)->{[0]@localhost:50762}
   └── [1]@localhost:50760 SORT (LIMIT 2)
      └── [1]@localhost:50760 MAIL_RECEIVE(HASH_DISTRIBUTED)
         └── [2]@localhost:50760 MAIL_SEND(HASH_DISTRIBUTED)->{[1]@localhost:50761,[1]@localhost:50760}
            └── [2]@localhost:50760 SORT (LIMIT 3)
               └── [2]@localhost:50760 TABLE SCAN (basic_order_by_basic) {OFFLINE=[basic_order_by_basic_OFFLINE_e625b8e5-ede7-40e3-8696-1992ecee3f9d]}

Notice that there are now two SORT operators, one right after the table scan and another right after the mail receive (the operator that consolidates responses from both localhost:50760 and localhost:50761).
Why
Without this change, the leaf nodes have no knowledge of how much data they should send to the multistage intermediate servers. You can imagine why this is a problem: if a query specifies LIMIT 3 but queries a large data set with low selectivity, the server nodes will respond to the intermediate node with potentially gigabytes of data. This compounded with the observation that our current engine has no flow-control that pipes down to v1 (leaf server queries will complete in entirety before sending any data back) means that before this change our queries were likely to timeout (and cost a lot of money in network bandwidth).

Codecov Report

Merging #9832 (adb3106) into master (16704a3) will decrease coverage by 48.35%.
The diff coverage is 12.32%.

@@              Coverage Diff              @@
##             master    #9832       +/-   ##
=============================================
- Coverage     64.18%   15.82%   -48.36%
+ Complexity     4977      175     -4802
=============================================
  Files          1911     1913        +2
  Lines        102620   102738      +118
  Branches      15612    15627       +15
=============================================
- Hits          65862    16263    -49599
- Misses        31983    85280    +53297
+ Partials       4775     1195     -3580

Flag
Coverage Δ

unittests1
?

unittests2
15.82% <12.32%> (+0.07%)
:arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files
Coverage Δ

...not/core/operator/combine/BaseCombineOperator.java
0.00% <0.00%> (-86.91%)
:arrow_down:

...nMaxValueBasedSelectionOrderByCombineOperator.java
0.00% <0.00%> (-62.42%)
:arrow_down:

...rator/combine/SelectionOrderByCombineOperator.java
0.00% <0.00%> (-65.63%)
:arrow_down:

...core/query/selection/SelectionOperatorService.java
0.00% <0.00%> (-94.45%)
:arrow_down:

...t/core/query/selection/SelectionOperatorUtils.java
0.00% <0.00%> (-92.26%)
:arrow_down:

...org/apache/pinot/query/planner/stage/SortNode.java
85.00% <0.00%> (-9.45%)
:arrow_down:

...pinot/query/planner/logical/IntExprRexVisitor.java
14.28% <14.28%> (ø)

...not/query/planner/logical/RelToStageConverter.java
83.33% <100.00%> (ø)

...ache/pinot/query/planner/logical/StagePlanner.java
100.00% <100.00%> (ø)

...che/pinot/query/runtime/operator/SortOperator.java
93.33% <100.00%> (ø)

... and 1228 more

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more

@Jackie-Jiang - yes, the V2 engine requires that the server returns columns in the order that would be the result of the logical plan (and also that it doesn't have extra or missing columns, which could be the case of the order by column wasn't selected or a column was selected multiple times).
Calcite makes assumptions that each stage will return results that are "correct" for that logical stage. The alternative would be, instead of building this into v1, wrapping the v2 leaf stage with an operator that rearranges columns but it felt like this flag would be the exact thing we should leverage.

@Jackie-Jiang - yes, the V2 engine requires that the server returns columns in the order that would be the result of the logical plan (and also that it doesn't have extra or missing columns, which could be the case of the order by column wasn't selected or a column was selected multiple times).
Calcite makes assumptions that each stage will return results that are "correct" for that logical stage. The alternative would be, instead of building this into v1, wrapping the v2 leaf stage with an operator that rearranges columns but it felt like this flag would be the exact thing we should leverage.

Is it possible we re-arrange columns in intermediate stage instead if we pass data schema to intermediate stage? This way we can leave the leaf stage untouched.

Is it possible we re-arrange columns in intermediate stage instead if we pass data schema to intermediate stage? This way we can leave the leaf stage untouched.

@61yao no it isn't, I tried that for the initial PR but we generate data schemas based on the result of the calcite logical plan. I tried hacking calcite to allow that behavior and it gets really brittle (it complains during the validation phase that the expected schema and the operator schema don't match up)

Currently serverReturnFinalResult is used by v1 engine to return the final aggregation result instead of the intermediate aggregation result.
The purpose for the flag in this PR is to order the columns based on the selection sequence (IIUC, the query constructed from v2 will always have order-by columns included in the selection sequence). This flag can also be applied to group-by queries which currently put group-by columns in from of other columns. We don't want to overload the same flag, so I'd suggest adding a separate flag for it.
Alternatively, is it possible to construct the leaf stage query in a way that the v1 result always match the logical stage order?

@Jackie-Jiang - I removed the usage of this flag and v1 changes, this PR now only affects the multistage engine :) hopefully there's no concerns now


Media object to Capital Framework

Can we get the media and media object styles added to Capital Framework so we can use it as a dependency on Owning a Home?
I'm happy to attempt this and submit a PR if y'all think it's worth adding to CF.

:+1: go for it. Not sure about @anselmbradford and @sebworks but my backlog is backing up a bit so I probably won't have time till after this Sprint.

These are also overdue for being consolidated into a single thing, I think. Still not sure why we ended up with two implementations. @virginiacc was involved in the creation of one of these, perhaps she can lend a hand.

I forget if it's media or media object, but @sebworks and I found that one or both of them has a top margin to align it with the line-height of heading text, when it is placed next to an <h1>, for example. This feels like an approach that's not ready for CF, since the alignment would be off if the heading text had a background color or border-top. Ideally with consolidating these two that could be looked at as well.

Good point about consolidation, @Scotchester -- it's definitely redundant to have both. I was working on pulling the image cropping functionality out of the media-object code so they could be combined. I'll see if that's ready to go and put in a pull request.

Just added a PR to move the post summary image cropping into its own class and combine the media objects.

The two media objects were consolidated in PR #325, so we should now be able to proceed with moving this out of the project.

@virginiacc or @cfarm, do you still need this moved into CF or was this already done?

Closing since it wasn't needed. We'll open a new issue and try to be more responsive about moving things out in the future!

Was this moved?

Nope, it wasn't needed.
On Thu, Aug 13, 2015, 6:22 AM Ans<EMAIL_ADDRESS>wrote:

Was this moved?
—
Reply to this email directly or view it on GitHub
https://github.com/cfpb/cfgov-refresh/issues/321#issuecomment-130668262.


Accessors on TsdUnit

Added accessors to TsdUnit to faciliate serialization in metrics-vertx-extra; this needs to be formalized in the next major revision

LGTM


BUG: fix special.struve returns NaN for values close to zeros (#19580)

Closes #19580, closes #5979
When calculating the struve function using the power series (https://dlmf.nist.gov/11.2.1), if the z is close to giving result that is a zero of the function, the error boundaries don't evaluate the result accordingly, so the value calculated, even tough it is correct, doesn't pass the conditions and returns NaN. With Asymptotic expansions we can catch some of those situations (https://dlmf.nist.gov/11.6.5) and we can also check the error margin to let the values be returned.

Hi @person142 @steppi , sorry to bother, but when you have the chance, can you take a look at my pull request? Thank you.

Hello @steppi, is there a chance you can take a look at my pr?

In the mean time @GreenMemory16 could you resolve the merge conflicts

Hi @GreenMemory16, thanks for submitting this fix. The merge conflict is because we've recently translated all of cephes into C++ which can also run on CUDA as part of the project described here. You can find the the relevant function here now: https://github.com/scipy/scipy/blob/c0fa9e36168c24ce6772e054653c82c73e083d56/scipy/special/special/cephes/struve.h#L293.

Thanks, I'll fix it as soon as possible

Hi @GreenMemory16, did you mean to close this?

Hi @GreenMemory16, did you mean to close this?

No, I'm sorry. Put it is reopen now

When you have a chance, can you take a look at this pr @steppi?

@GreenMemory16 Thanks for submitting this. Did you see that you have a review waiting, and were you still interested in finishing?

Hello, sorry for the time it took for me to reply.
I don't currently have the time, nor the level of confidence to tackle this issue.
I think i''l let someone else grab this
Sorry again for the time it took for me to reply.

Thanks for replying! Can you just reply to the questions @steppi wrote above so we can determine whether we should continue with the approach? Specifically, was there a theoretical backing for this, and how was 1e-22 chosen?

Ok, that's @GreenMemory16! In that case, I'll go ahead and close this so others can give it a shot.


Disable building background folding components when TBB is missing

Summary
(Cherry-picked fix)
OV can be built without TBB (e.g. when setting -DTHREADING=SEQ during build). This is the scenario encountered for ChromeOS. When the plugin is being build with OV in this case, the build fails as it has a dependency on TBB for constant folding in background.
To resolve this build dependency, the components of constant folding in background are disabled from being built when OV_THREAD is not set to TBB or TBB_AUTO. As a result, background folding is not an available feature for this case.
Target Platform For Release Notes (Mandatory)
Aids the generation of release notes

[ ] VPUX30XX
[ ] VPUX31XX
[ ] VPUX37XX
[x] NONE (Not included in release notes)

Classification of this Pull Request

[ ] Maintenance
[x] BUG
[ ] Feature

Related PRs

PR-xxx description

Code Review Survey (Copy and Complete in your code review)

number_minutes_spent_on_review[0]
number_p1_defects_found[0]
number_p2_defects_found[0]
number_p3_defects_found[0]
number_p4_defects_found[0]

@Maxim-Doronin hi! Could you please take a look at this PR?


Research calls to action

[ ] Are/can widgets a part of the API?
[ ] If not, these will need to be a custom post type
[ ] Placement & API response

Create Custom Post type
Create Menus for each region.

in a custom plugin


Change routes.php path

Change routes.php path to the Laravel 5 (app/Http/routes.php) instead of old Laravel 4 (app/routes.php).

Thanks @AAlakkad


Display App server info

Created DataProviders to:

gather info about system and wiki configurations;
gather info about system and wiki security;

Created templates for DataProviders;
Created server identifiers used to help identify the used server;
Created a listener to call the server identifier when the user changes the path from the wiki configurations;
Created a Dashboard application;
Added translations;
Created unit tests.

Case when server is not found:
Case when server is found:


Fix incorrect date check for ao nightlies

Our nightly recipe test CI job is failing because we aren't parsing the dates in ao nightlies correctly. We gate a feature on the 7/3 nightly, which is represented as "2024.7.3+cu121" (e.g.). But "2024.7.3+cu121" >= e.g. "2024.7.13+cu121", so we can't compare the raw strings.
This PR adds a util to convert everything to datetime objects so that we're comparing across a standardized format.
Test plan: added PR trigger to nightly recipe test, will confirm CI is green then remove it

Codecov Report
Attention: Patch coverage is 66.66667% with 2 lines in your changes missing coverage. Please review.

Project coverage is 68.11%. Comparing base (a129b55) to head (1367b8e).
Report is 10 commits behind head on main.

Files
Patch %
Lines

torchtune/modules/low_precision/_utils.py
50.00%
2 Missing :warning:

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1176      +/-   ##
==========================================
- Coverage   68.32%   68.11%   -0.22%
==========================================
  Files         215      214       -1
  Lines        9722     9687      -35
==========================================
- Hits         6643     6598      -45
- Misses       3079     3089      +10

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


dep vendors the entirety of golang.org/x/net when the only dependency is x/net/websocket

I decided to give the tyres of dep a bit of a kick and ran into a bit of a headache. I'm using go1.8 linux/amd64. To demonstrate the problem I'm having with my real project, I created a simple package with the following source:
package main
import (
	"fmt"
	"golang.org/x/net/websocket"
)
func main() {
	var conn *websocket.Conn
	fmt.Println(conn)
}

Once I run dep init in the project's directory, I get a whole stack of stuff nobody asked for:
$ ls vendor/golang.org/x/net/
AUTHORS         context          dict  http2  internal  lex      nettest  proxy         route   websocket
bpf             CONTRIBUTING.md  dns   icmp   ipv4      LICENSE  netutil  publicsuffix  trace   xsrftoken
codereview.cfg  CONTRIBUTORS     html  idna   ipv6      lif      PATENTS  README        webdav

I would expect to only see x/net/websocket in the vendor directory, which is the behaviour I get from govendor.
Perhaps this isn't actually an issue with dep - go list -f '{{.Deps}}' golang.org/x/net/websocket reports a whole slew of dependencies never imported by x/net/websocket, but I prefer to commit my vendor directory and I'm getting megabytes of redundant stuff instead of the 92kb I'm expecting from the only package I actually want.
I could be misunderstanding something here, but from what I can see, none of these imports listed should yield anything else in x/net:
$ go list -f '{{.Imports}}' golang.org/x/net/websocket
[bufio bytes crypto/rand crypto/sha1 crypto/tls encoding/base64 encoding/binary encoding/json errors fmt io io/ioutil net net/http net/url strings sync time]

But that's not what actually ends up happening:
$ go list -f '{{.Deps}}' golang.org/x/net/websocket
[bufio bytes compress/flate compress/gzip container/list context crypto crypto/aes crypto/cipher crypto/des crypto/dsa crypto/ecdsa crypto/elliptic crypto/hmac crypto/internal/cipherhw crypto/md5 crypto/rand crypto/rc4 crypto/rsa crypto/sha1 crypto/sha256 crypto/sha512 crypto/subtle crypto/tls crypto/x509 crypto/x509/pkix encoding encoding/asn1 encoding/base64 encoding/binary encoding/hex encoding/json encoding/pem errors fmt hash hash/crc32 internal/nettrace internal/race internal/singleflight internal/syscall/unix io io/ioutil log math math/big math/rand mime mime/multipart mime/quotedprintable net net/http net/http/httptrace net/http/internal net/textproto net/url os path path/filepath reflect runtime runtime/cgo runtime/internal/atomic runtime/internal/sys sort strconv strings sync sync/atomic syscall time unicode unicode/utf16 unicode/utf8 unsafe vendor/golang_org/x/crypto/chacha20poly1305 vendor/golang_org/x/crypto/chacha20poly1305/internal/chacha20 vendor/golang_org/x/crypto/curve25519 vendor/golang_org/x/crypto/poly1305 vendor/golang_org/x/net/http2/hpack vendor/golang_org/x/net/idna vendor/golang_org/x/net/lex/httplex vendor/golang_org/x/text/transform vendor/golang_org/x/text/unicode/norm vendor/golang_org/x/text/width]

Hi, welcome! Thanks for giving dep a try, and for writing such a detailed report! 🎉
This is the pruning problem, and is definitely a known issue. There's a lot of discussion over in #120. Short version: we have all the information on hand that's needed to prune, but doing so poses safety concerns in the general case. But we understand it's important, and do intend to have some kind of solution - maybe in dep itself, maybe as a separate tool.
(Closing as a dupe - but again, thanks for taking such care in your writeup!)

Oh damn, I did try searching for this in the issues but I guess I didn't hit on the correct terms. Sorry to waste your time!

No worries!


Component Exception: null is not an object (evaluating 'StripePayments.init')

When calling stripe.setOptions(publishingKey(publicKey)) Component Exception error: null is not an object (evaluating 'StripePayments.init')

Hi, are you initializing SDK by calling stripe.setOptions({ publishingKey: 'STRIPE_PUBLISHING_KEY' }); ?

Hi, are you initializing SDK by calling stripe.setOptions({ publishingKey: 'STRIPE_PUBLISHING_KEY' }); ?

Yeah, exactly like that, as an object.  Does it matter where I initialise it?

Yeah, exactly like that, as an object.  Does it matter where I initialise it?

Nope. But null is not an object indicates that somewhere it's not being passed as an object. I'm just wondering if {publishingKey: "..."}

Nope. But null is not an object indicates that somewhere it's not being passed as an object. I'm just wondering if {publishingKey: "..."}

Okay, thanks so much for your help.  In the end, it was a mistake I made when duplicating one of my projects, I forgot to rename some the Xcode files.

Okay, thanks so much for your help.  In the end, it was a mistake I made when duplicating one of my projects, I forgot to rename some the Xcode files.


Remove API outages section

What
Remove "API access may have brief outages during beta" section. PaaS team did the work required to monitor and remove downtime during deployments.
How to review
Describe the steps required to test the changes.

Preview the content locally (see README) and check that it renders as expected.
Manually check that any removed or renamed anchor tags are not in use (linkchecker doesn't do this).
Check that it addresses https://www.pivotaltracker.com/story/show/155903882

Who can review
Anyone except Jon Glassman

🎉 🎉 🎉 🎉 🎉


Understanding of Beckn Onix

Description
This issue aims to facilitate a comprehensive understanding of the Beckn Onix framework.
Goals

[x] Detailed study of the Beckn Onix framework.
[x] Document the key functionalities and components.

Expected Outcome
A well-documented and thoroughly understood Beckn Onix framework, with team members equipped with the necessary knowledge to effectively utilize and implement it in projects.
Acceptance Criteria

[x] Key functionalities and components clearly outlined.
[x] Knowledge base created and accessible to all team members.

Mockups / Wireframes
NA
Product Name
Beckn
Domain
Onix
Tech Skills Needed

In-depth knowledge of Beckn Onix framework
Documentation and technical writing skills

Complexity
Medium
Category
Knowledge Sharing
Sub Category
Training and Documentation

Went through documentations, diagrams, etc to under beckn onix and its working.

Review Completed
He is able to install BecknOnix in his system, and have the understanding of the beckn onix


Do we have an option to export pfx with password?

https://docs.microsoft.com/en-us/azure/app-service/configure-ssl-certificate#export-certificate
From this document, it says "The downloaded appservicecertificate.pfx file is a raw PKCS12 file that contains both the public and private certificates. In each prompt, use an empty string for the import password and the PEM pass phrase.", But when I tried this command
az keyvault secret download
--file appservicecertificate.pfx
--vault-name
--name $secretname
--encoding base64
It didn't show any prompt to let me input password, so as downloading pfx from KeyVault.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: cc2ee874-df45-1de2-1b30-1fd75c7fd709
Version Independent ID: ee181722-8386-9842-407f-d0549012d2e9
Content: Add and manage TLS/SSL certificates - Azure App Service
Content Source: articles/app-service/configure-ssl-certificate.md
Service: app-service
GitHub Login: @cephalin
Microsoft Alias: cephalin

@rachelxj-ms At this time you cannot set the password when exporting App Service Certificates. You should be able to follow the below steps though on your local machine to end up with a password protected pfx file

Double click the downloaded certificate and mark on the check box: Mark this key as exportable.

Next, complete and finish.

Now open the MMC tool and add the certificate.

Once the certificate was added, please go to Personal -> Certificates

Select your certificate -> All Task -> Export -> Yes export the private key

Now save the certificate

With these steps you will create a pfx file with a private key password.
We will now proceed to close this thread. If there are further questions regarding this matter, please tag me in your reply. We will gladly continue the discussion and we will reopen the issue.

@BryanTrach-MSFT  would you please update the document about that we don't have password when we download pfx from Azure App Certificate?


Laravel Exceptions have empty getMessage()

Laravel Version: v5.3.26
PHP Version: 7.0.10
Database Driver & Version: mysql:5.7

Hi,
I am trying to implement an api implementation using laravel. For this I want all Exceptions to return their value as JSON to my frontend. The right place seemed to be function render in Handler.php in App\Exceptions. But Exceptions thrown by laravel/symfony never seem to provide the readable message. They seem to add the corresponding message later. This is basicly what I want to implement in Handler.php:
public function render($request, Exception $exception) {
    $error_response = [
        'error' => $exception->getMessage(),
        'error_code' => $exception->getStatusCode(),
    ];
    return response()->json($error_response, $exception->getStatusCode());
}

When I now route to a non-existant page, I have the following result:
HTTP/1.0 404 Not Found
Cache-Control: no-cache
Connection: close
Content-Length: 29
Content-Type: application/json
Date: Wed, 21 Dec 2016 12:25:23 GMT
Server: Apache/2.4.10 (Debian)
Vary: Authorization
X-Powered-By: PHP/7.0.10

{
    "error": "",
    "error_code": 404
}

I want the "Not Found" - Response to be in JSON. The code is already right, but getMessage() always seem to be empty within builtin Exceptions.  If I raise my own Exception:
use Symfony\Component\HttpKernel\Exception\NotFoundHttpException;
throw new NotFoundHttpException("Pageee not found");

I have the Message set correctly:
HTTP/1.0 404 Not Found
Cache-Control: no-cache
Connection: close
Content-Length: 45
Content-Type: application/json
Date: Wed, 21 Dec 2016 12:29:51 GMT
Server: Apache/2.4.10 (Debian)
Vary: Authorization
X-Powered-By: PHP/7.0.10

{
    "error": "Pageee not found",
    "error_code": 404
}

It seems that the code is provided but the Response-text is set later. Is there a way to find out the HTTP Response Message in a "laravel way", so I can give it back in my JSON? I tried all dumping of the Excpetion.

Please ask on the forums, we try to keep this repo for bug reporting only. Thanks for understanding :)


Implement Biomes correctly

Currently something works, though it was entirely unintentional, and should be entirely rewritten.

Closed by https://github.com/OpenCubicChunks/CubicChunks/pull/607


Add "Syntax Request" label for new issues

Description of the feature
I was wondering if it would useful to have a "syntax request" label for new issues. Sometimes it seems like it should be possible for me to use pyaedt as is, but I can't figure out the syntax from the API documentation. In these cases, I could choose the "syntax request" label as opposed to the "bug" label. Just an idea. Thanks!
Steps for implementing the feature
Create "syntax request" label for new issues (or something like that).
Useful links and references
No response

@maxcapodi78 I could add a label for "help/support".

Perfect, thank you!

@MaxJPRey Can you take this action? I think it is a good idea to add it to issue templates

@maxcapodi78 Yes, I will add this label.


  It typically happens on a large file and the few files that get removed while the large one is still deleting.  Here is a simpler use case to reproduce the problem (note how the large files fail, but the small files usually work fine) ...
root@wreese-aio:/mnt/cfs# dd if=/dev/zero of=test1 bs=1M count=10 && dd if=/dev/zero of=test2 bs=1M count=10 && rm test2 && cp test1 test2
10+0 records in
10+0 records out
10485760 bytes (10 MB) copied, 0.343236 s, 30.5 MB/s
10+0 records in
10+0 records out
10485760 bytes (10 MB) copied, 0.322108 s, 32.6 MB/s
cp: cannot create regular file ‘test2’: Input/output error
root@wreese-aio:/mnt/cfs# dd if=/dev/zero of=test1 bs=4k count=1 && dd if=/dev/zero of=test2 bs=4k count=1 && rm test2 && cp test1 test2
1+0 records in
1+0 records out
4096 bytes (4.1 kB) copied, 0.0072833 s, 562 kB/s
1+0 records in
1+0 records out
4096 bytes (4.1 kB) copied, 0.00199768 s, 2.1 MB/s


Use ServiceWorker's caching API to support offline reading

Added a basic ServiceWorker, so the main article page is now cached for offline reading.
Still need to fetch figures etc so that they are available offline.

Note that this isn't a complete offline solution, as the resources aren't cached until the ServiceWorker is controlling the page, which doesn't happen on first load.


Reshape q-values in lowmem version

The indentation of the reshape applied it only in the lowmem=False version

Thanks!


Simplify Elastic Kibana Dashboard URL configuration

Simplify Elastic Backend configuration to define the Jenkins Health Dashboard URL

[x] Make sure you are opening from a topic/feature/bugfix branch (right side) and not your main branch!
[x] Ensure that the pull request title represents the desired changelog entry
[x] Please describe what you did
[ ] Link to relevant issues in GitHub or Jira
[ ] Link to relevant pull requests, esp. upstream and downstream changes
[ ] Ensure you have provided tests - that demonstrates feature works or fixes the issue

@v1v

I'm wondering if we should revisit the title of the Jenkins Health Dashboard in Kibana. "CI/CD Overview" is very generic, "Jenkins Overview" is probably more accurate.
Could we bundle the 2 Jenkins dashboards in the same .ndjson file?

Could we bundle the 2 Jenkins dashboards in the same .ndjson file?

IIRC every line is an object to import in Kibana so yes you can.


Post-process logs for ranked lists?

Could you extend the log post-processing to extract ranked lists by file (maybe top {configurable}?) of escaped, timed-out, etc mutations as a quick summary / hints to guide further work?
Idea being if (say) FooController.php has the most escaped mutants out of all files mutated, then you can tell that at a glance from a table, rather than having to scroll through a (possibly rather extensive) log.

If this is still an issue, I've recently started a simple log processor for humbug json logs. It generates static html like the PHPUnit coverage.
You can find it at https://github.com/letscodehu/humbughtml

I think it would be nice to support different output format.


Specify a different build directory instead of .next

I am trying to deploy next to Firebase functions, and It looks like the .next build directory is ignored by firebase cli.
Firebase cli seems to ignore all hidden files, so I want to use a differently named directory.
The directory seems to be hardcoded in 3 places:
/dist/bin/next-start
/dist/server/build/clean.js
/dist/server/build/index.js

Would this be something that would like to be added via config? maybe next.config? If so, I can take a look at this?

Yep. That's the api we could do it.

Im having a look at this now. Is there any standards or practices against config? For sake of testing it out im running the following in next.config:
module.exports = {
  options: {
    dest: 'dist'
  }
}

Have any other ideas?

I'd like to see it like this:
module.exports = {
  options: {
    dist: '.next'
  }
}

no worries, got some of it done last night. WIll continue with it tonight 👍

Pr incoming for this; just updating documentation.

@abstractpoint @arunoda https://github.com/zeit/next.js/pull/1599 Opened a PR for it; let me know if any issues.
Cheers

@abstractpoint this is now merged if you want to try on latest master.

@alexnewmannn Working great, super useful. Thank you for putting in the time! (Still battling with Firebase being too slow running next, but that's not really related)


Cannot npm install: artifactory.alteryx.com not available

Hi everyone,
when cloning the repository and running npm install, the installation fails with the following error message:
❯ npm install
npm ERR! code ENOTFOUND
npm ERR! syscall getaddrinfo
npm ERR! errno ENOTFOUND
npm ERR! network request to https://artifactory.alteryx.com/artifactory/api/npm/npm/yargs/-/yargs-13.3.2.tgz failed, reason: getaddrinfo ENOTFOUND artifactory.alteryx.com
npm ERR! network This is a problem related to network connectivity.
npm ERR! network In most cases you are behind a proxy or have bad network settings.
npm ERR! network
npm ERR! network If you are behind a proxy, please make sure that the
npm ERR! network 'proxy' config is set properly.  See: 'npm help config'

npm ERR!      /Users/c.harms/.npm/_logs/2021-05-23T10_18_34_757Z-debug.log

The relevant lines in the log file are as follows:
1538 timing reifyNode:node_modules/@material-ui/styles Completed in 5620ms
1539 timing reifyNode:node_modules/react-select Completed in 5688ms
1540 timing reifyNode:node_modules/dom-helpers Completed in 5694ms
1541 timing reifyNode:node_modules/@alteryx/icons Completed in 5730ms
1542 timing reifyNode:node_modules/@material-ui/lab Completed in 5790ms
1543 timing reifyNode:node_modules/@alteryx/ui Completed in 5933ms
1544 timing reifyNode:node_modules/babel-plugin-polyfill-corejs3/node_modules/caniuse-lite Completed in 5996ms
1545 timing reifyNode:node_modules/lodash Completed in 6061ms
1546 timing reifyNode:node_modules/core-js Completed in 6143ms
1547 timing reifyNode:node_modules/@material-ui/core Completed in 6214ms
1548 timing reify:rollback:createSparse Completed in 982ms
1549 timing reify:rollback:retireShallow Completed in 0ms
1550 timing command:install Completed in 8025ms
1551 verbose type system
1552 verbose stack FetchError: request to https://artifactory.alteryx.com/artifactory/api/npm/npm/yargs/-/yargs-13.3.2.tgz failed, reason: getaddrinfo ENOTFOUND artifactory.alteryx.com
1552 verbose stack     at ClientRequest.<anonymous> (/usr/local/lib/node_modules/npm/node_modules/minipass-fetch/lib/index.js:97:14)
1552 verbose stack     at ClientRequest.emit (node:events:365:28)
1552 verbose stack     at TLSSocket.socketErrorListener (node:_http_client:447:9)
1552 verbose stack     at TLSSocket.emit (node:events:377:35)
1552 verbose stack     at emitErrorNT (node:internal/streams/destroy:193:8)
1552 verbose stack     at emitErrorCloseNT (node:internal/streams/destroy:158:3)
1552 verbose stack     at processTicksAndRejections (node:internal/process/task_queues:83:21)
1553 verbose cwd /Users/c.harms/Code/External Libs/dev-harness
1554 verbose Darwin 20.4.0
1555 verbose argv "/usr/local/Cellar/node/16.2.0/bin/node" "/usr/local/bin/npm" "install"
1556 verbose node v16.2.0
1557 verbose npm  v7.13.0
1558 error code ENOTFOUND
1559 error syscall getaddrinfo
1560 error errno ENOTFOUND
1561 error network request to https://artifactory.alteryx.com/artifactory/api/npm/npm/yargs/-/yargs-13.3.2.tgz failed, reason: getaddrinfo ENOTFOUND artifactory.alteryx.com
1562 error network This is a problem related to network connectivity.
1562 error network In most cases you are behind a proxy or have bad network settings.
1562 error network
1562 error network If you are behind a proxy, please make sure that the
1562 error network 'proxy' config is set properly.  See: 'npm help config'
1563 verbose exit 1

I could not find an explicit reference to https://artifactory.alteryx.com, but I'm not very familiar with npm, so not sure where to look for a fix. At least it seems to try to get packages from this URL, which is not publicly available.
The problem occurred initially when running from a properly set up Alteryx SDK workspace.
Looking forward to a fix!
Best
Christopher
(see also my post in the Alteryx Community: https://community.alteryx.com/t5/Dev-Space/Alteryx-UI-SDK-Not-able-to-launch-Dev-Harness/td-p/763169)

Quick follow-up: when deleting the package-lock.json file containing the URLs in question, I get a problem with the dependencies:
❯ npm install
npm ERR! code ERESOLVE
npm ERR! ERESOLVE unable to resolve dependency tree
npm ERR!
npm ERR! While resolving<EMAIL_ADDRESS>npm ERR! Found<EMAIL_ADDRESS>npm ERR! node_modules/react-intl
npm ERR!   dev<EMAIL_ADDRESS>from the root project
npm ERR!
npm ERR! Could not resolve dependency:
npm ERR! peer<EMAIL_ADDRESS>from<EMAIL_ADDRESS>npm ERR! node_modules/@alteryx/ui
npm ERR<EMAIL_ADDRESS>from the root project
npm ERR!
npm ERR! Fix the upstream dependency conflict, or retry
npm ERR! this command with --force, or --legacy-peer-deps
npm ERR! to accept an incorrect (and potentially broken) dependency resolution.
npm ERR!
npm ERR! See /Users/c.harms/.npm/eresolve-report.txt for a full report.

npm ERR!      /Users/c.harms/.npm/_logs/2021-05-23T10_23_31_410Z-debug.log

Hey @neurotroph, thanks so much for being the first person to file an issue with the new UI-SDK! We really appreciate the feedback.
I think this will be pretty easy to resolve. Can you do me a favor and delete both the package-lock.json file and the node_modules folder in the project? Then, do a fresh npm install.
We'll have some work to do on our side to ensure this doesn't happen for anyone else in the future (removing the existing package-lock.json and starting with a fresh one), but this should get you unblocked. If not, let me know!

Hey @neurotroph, thanks so much for being the first person to file an issue with the new UI-SDK! We really appreciate the feedback.
I think this will be pretty easy to resolve. Can you do me a favor and delete both the package-lock.json file and the node_modules folder in the project? Then, do a fresh npm install.
We've opened a PR to address that here so that nobody else runs into this issue.
Thanks!

Hey @jordan-quinn-alteryx!
I did delete both the package-lock.json and the node_modules folder and receive the same version conflict error as above:
❯ npm install
npm ERR! code ERESOLVE
npm ERR! ERESOLVE unable to resolve dependency tree
npm ERR!
npm ERR! While resolving<EMAIL_ADDRESS>npm ERR! Found<EMAIL_ADDRESS>npm ERR! node_modules/react-intl
npm ERR!   dev<EMAIL_ADDRESS>from the root project
npm ERR!
npm ERR! Could not resolve dependency:
npm ERR! peer<EMAIL_ADDRESS>from<EMAIL_ADDRESS>npm ERR! node_modules/@alteryx/ui
npm ERR<EMAIL_ADDRESS>from the root project
npm ERR!
npm ERR! Fix the upstream dependency conflict, or retry
npm ERR! this command with --force, or --legacy-peer-deps
npm ERR! to accept an incorrect (and potentially broken) dependency resolution.
npm ERR!
npm ERR! See /Users/c.harms/.npm/eresolve-report.txt for a full report.

npm ERR!      /Users/c.harms/.npm/_logs/2021-05-25T09_23_14_060Z-debug.log

What did the trick for me, was to replace all "artifactory.alteryx.com" references in the package-lock.json with npm.org URLs. At least that's how I've got it to work for now. :)

@neurotroph I'm glad you came to a solution! That's essentially exactly what our PR did I linked to above did. I'm guessing the CLI cached your package-lock.json and/or node_modules and that's why deleting them and re-installing didn't do what I expected.
Moving forward, new workspaces created using the latest dev harness shouldn't have this issue.


Support for git?

Expected Feature
Hey, i want to add git commands to my docs. but it seems doesn't highlighted.

How can i do?

Seems no one has written a highlighter for git. I don’t see it in our languages folder.


Underline is not displayed correctly

If I use underscores in the MySQL action (e.g. user or password), this is not displayed correctly in the browser. The input field is too narrow. Example: https://i.imgur.com/GrS361T.png

Yes, I am aware of this "issue". I have to dig a bit more to see how a better approach would be.

Try to increase the padding of the css-class .ace_editor with 10px


pull request for e2e test at 12/20/2016 15:56:22

:white_check_mark: Validation status: passed
For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Added notification frequency setting in YAML and logic to use it.

Resolves: #28
Using notifier_frequency: 720 in blackbox.yaml we set how many notifications we want to see inside one day.
Logic is simple - keep last time of notification and check if we can send. Otherwise increase integer value of attempts to show it later in logs.
First start, sending:
blackbox    | 06:56:11 Recreating json with period: 28800

Frequency in YAML changed, sending:
blackbox    | 07:05:00 Found json, reading it...
blackbox    | 07:05:00 Frequency changed. Recreating json with period: 120

Unsuccessful attempt to send:
blackbox    | 07:06:51 Found json, reading it...
blackbox    | 07:06:51 Can't send notification, 111 < 120.

Successful attempt to send after period:
blackbox    | 07:07:07 Found json, reading it...
blackbox    | 07:07:07 Recreating json with period: 120
blackbox    | 07:07:07 By the way there were 6 successful backups.

I need confirmation that logic is okay and location of JSON is appropriate and then I will update README file.

I don't think I like this approach, it just feels wrong to me to specify it as a number of notifications per day. I don't want to force the users to do maths in order to figure out how to configure this. It just seems like bad user experience.
I envisioned this feature more like a cooldown for success notifications that the user would configure. The user sets the cooldown to one hour, and every subsequent success notification will happen no sooner than 1 hour after the previous one.
I think it's more intuitive to think of this in terms of time, rather than number of notifications in a day.

I've changed logic to cooldown as you asked.
Cooldown
By default, blackbox will send all notification at every backup attempt.
You can specify a cooldown period in blackbox.yaml during which all notifications will be muted.
This option will not mute failed backups.
Example usage
cooldown: 120s

cooldown: 3 hours

cooldown: 2 days 4 hours

cooldown: 4h 32M 16s


sound not working

Samsung Galaxy S6,  Android 5.0.2 - Game runs very fast 30 - 40 fps on a default world with all biomes, with very little lag, but it has no sound or music at all in game or on menu screen. - minecraft 1.7.10

Can someone please help...  Boardwalk 1.1, Minecraft 1.7.10 runs perfectly on Samsung Galaxy S6 except sound and music does not work even though ALL game and device volumes are on max.
When I download minecraft through boardwalk it always says waiting for sound files to download then loads the game fine but sounds dont work, I have tried other versions of Minecraft including 1.8, 1.8.4 ect and still no sounds or in game music. Its a shame because this device runs this game about 2 times faster than the Shield Tablet which i had last year!
Bye.

me too i have an smg900f s5 international with 2gb ram game is extremely laggy and no in game or menu sound please zhouieng send me boardwalk file!!


Invalid connection string attribute

Environment
To diagnose, we usually need to know the following, including version numbers.  On Windows, be
sure to specify 32-bit Python or 64-bit:

Python: Python 3.5.2
pyodbc: 4.0.25
OS: Ubuntu:16.04
DB: Microsoft SQL Server 2016 (SP1-CU8) (KB4077064) - 13.0.4474.0 (X64)
driver: ODBC Driver 13 for SQL Server

Issue
DB admin asked me about failed login message in db, like "Logon,Unknown,Login failed for user 'user'. Reason: Password did not match that for the login provided. [CLIENT: <IP_ADDRESS>]".
But there are no any exceptions in the service which works with this db. I turned on ODBC trace mode and discovered the situation like this:
                Entry:
                        Connection = 0x2f8e930
                        Window Hdl = (nil)
                        Str In = [DRIVER={ODBC Driver 13 for SQL Server};SERVER=<IP_ADDRESS>;PORT=1433;DATABASE=dbname;UID=user;PWD=pwd][length = 108 (SQL_NTS)]
                        Str Out = (nil)
                        Str Out Max = 0
                        Str Out Ptr = (nil)
                        Completion = 0
                UNICODE Using encoding ASCII 'ISO8859-1' and UNICODE 'UCS-2LE'

[ODBC][1464][1547213406.545475][SQLDriverConnectW.c][699]
                Exit:[SQL_ERROR]
[ODBC][1464][1547213406.545520][SQLDriverConnect.c][726]
                Entry:
                        Connection = 0x2f8e930
                        Window Hdl = (nil)
                        Str In = [DRIVER={ODBC Driver 13 for SQL Server};SERVER=<IP_ADDRESS>;PORT=1433;DATABASE=dbname;UID=user;PWD=*********][length = 107 (SQL_NTS)]
                        Str Out = 0x7ffda0246350
                        Str Out Max = 2048
                        Str Out Ptr = (nil)
                        Completion = 0
                UNICODE Using encoding ASCII 'ISO8859-1' and UNICODE 'UCS-2LE'
                DIAG [01000] [Microsoft][ODBC Driver 13 for SQL Server][SQL Server]Changed database context to 'dbname'.
                DIAG [01000] [Microsoft][ODBC Driver 13 for SQL Server][SQL Server]Changed language setting to us_english.
                DIAG [01S00] [Microsoft][ODBC Driver 13 for SQL Server]Invalid connection string attribute

ODBC repeats the action several times and after success continues to work. The connection string itself is valid and the problem is hardly reproduced, once in several thousand connections.
After rolled back on pyodbc==4.0.24 problem was solved.

Closed due to inactivity. Feel free to re-open with current information if necessary.


Extra catch() blocks are added to the RunSample() function.

It allows to notify users in case, when a call to AKS is failed (for example, if AKS is not registered in the provider).

@anuchandy, @yaohaizh
Please review.

@dorofeev-serdg Thanks for your contribution. This repo was  generated by tools and doesn't provide manually changes. You can open the PR against the original repo here: https://github.com/Azure/azure-libraries-for-net/blob/master/Samples/ContainerService/ManageContainerServiceWithKubernetesOrchestrator.cs

The PR is closed as not required.


Incorrect session time calculation.

On some occasions, some players have an incorrectly calculated session time. This can be attributed to a variety of reasons. Incorrect parsing of logs and or missing logs. Incorrect parsing of connect / disconnection dates, etc.
E.g

Seen above, some players have an unlikely or impossible session time.

Connect / Disconnect admin logs have appeared in incorrect order, causing an invalid session time calculation. Could be source of issue.

Solved in ^v9.9.5


[BUG] Iframe Not Working

Describe the bug
in flowise 1.8.2 Chatbot Imbedding iFrame no longer works, the chat bot only work within the canvas only

how are you using the iframe? can you give example code?

how are you using the iframe? can you give example code?

Hi Henry
I have installed The Flowise 1.8.2 in my ubuntu 20.04 server by using Docker,
I have created an agent and used the HTML imbedded iFrame in my WordPress website  for AI Tech support . and when I type or ask something it shows fetch error but when I downgraded to 1.8.1 it fixed
I can attach screen shot or take a video if you want to show you.

Feel free to re-open if issue still persists


DM-44568: Rewrite to use internal route for DDV worker pod-side websocket

A small change to the routing, with some renaming for clarity and a new route that utilises the pod-facing URL for connecting with worker pods.
There are also a few fixes/cases of retyping for mypy.

The build is failing in Jenkins because of the arbitrary sleep value in the final test that needs time to scrape the bucket, I think.
I've created a ticket to find a better way of dealing with this: https://rubinobs.atlassian.net/browse/DM-44663


chore: Move Python formatting and linting checks to ruff

Describe your changes
Move Python formatting and linting checks to ruff.
Checklist before requesting a review

[x] I updated CHANGELOG.MD with a description of my changes
[x] If the change was to a module, I ran the code validation script (scripts/validate.sh)
[x] If the change was to a module, I have added thorough tests
[x] If the change was to a module, I have added/updated the module's README.md
[x] If a module was added, I added a reference to the module to the repository's README.md
[x] I verified that my code deploys successfully using seedfarmer apply

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@LeonLuttenberger @malachi-constant Please hold merging this PR, we have a couple modules actively worked on that need to go before we change the formatting scripts. Ideally I'd like this to be merged when it's the only PR open against the repo so we don't impact others work.


Discussion of new features in the 0.0.4 beta/test version

As a result of the discussion, the following additions will be under observation

[!TIP]
If you have a better suggestion, please leave a comment below with idea!
Thanks )

add new dialect support of markdown:

color of text: red::#red green::#x00800 amablue::#x0000ff:0.2
tip: MDN::MDN web doc
the u element: md::  file from markdown
small annotations(ruby & rt): 行::!xing

FORMAT MAP (In some special text editing situations, you need to type this in order for it to be parsed properly):
Full write-up:
text::[work][sub-text|causality]:[value|void]:
key string|char："::",":"," "

<!--color of text:-->
red::#red:1:
red::#xff0000:1:

<!--Tip-->
MDN::MOZ://a org.::

<!--

underline

  => under
-->
md::!under::

<!--
annotations

'!'=>':! \n $s'
-->
:::!
唱 、 跳
chang   跳
:::

add new commands of ma-maic:

Replacement function loop: CTRL+SHIFT+E
[must open function lab] element query add: CTRL+ALT+X

This sloppy flowchart will give you a general description of how version 0.0.4 works
graph TD

z(["How to work"])

a[start]
b{enabled table of REGEX}

r-0[["REG0"]]
r-1[["REG1"]]
r-u[["User-defined"]]

r-u --> r-0 & r-1

c["forEach-main"]

e{{Enabled json options}}

o-0["vsc"]
o-1["compute"]
o-2["node"]
0-3["..."]

f["end"]

a -->b
b -->|yes|r-0
b -->|no|r-1

r-0 & r-1 -->c-->e
e --> o-0 & o-1 & o-2 & 0-3 --> f

RULES of callback function:
We added some callback function in activate,now,you can select you like package to setup！
How to fill in function parameters：
[function name]:[functions on package]
and then we export some functions:

REGX
Language
....

note will be creat, all change will be write

Because of permissions security,I have eliminated the OUTPUT on compute/node.(Addon support was removed)
That means using it through the ma-maic's core is forbidden!
But I worte a script that can be applied to NPM and DOCKER. As new extension on vscode.


Switch to Azure SDK v2

Migrate the cleanup logic to use Azure SDK v2 since v1 is deprecated
Followed instructions in https://github.com/Azure/azure-sdk-for-go/blob/main/documentation/MIGRATION_GUIDE.md
co-authored by @marosset

/assign @aramase
We will add support for Managed Identity in a separate PR

/hold
Please hold merge until we validate this

@aramase addresses all comments, test is passing, this is ready


Cache manual build tools

It seems autotools download fails from doing too much, it would be great to cache the tools in the GitHub Actions. This was already a problem we had with HTML Help Workshop from archive.org, so we would need to cache anyway.
https://github.com/actions/cache
I think something needs to pickup all the URLs from the workflow and contributing.md and put in a text file, and then use the resulting text file as key to the cache. Or just contributing.md and the workflow file directly.

I think in most cases the cache will have expired by the time the next build runs. I can't find a Ubuntu specific method to install a newer Autoconf version so until one is available I've just modified the existing download so that if the package revision changes it will still get picked up.
https://github.com/adventuregamestudio/ags-manual/commit/0d5b63149dfebbf14b3ffbfa2f7cdbe8e05aa9c2
If it breaks in any more significant way it is is probably best to just download the official release and build and install it. And ideally we should host it somewhere.

I don't understand much how brew works, but error I observed is this, if you look the URL below it will give an error
https://ghcr.io/v2/homebrew/core/automake/manifests/1.16.4
But it seems brew only occasionally hits this URL and not always.
Other than this, HTML Help Workshop could really use being cached, it can be occasionally a slow download. Or we could just put HTML Help Workshop somewhere here on GitHub to download it directly, like using an additional repository as binary file storage.

Perhaps it's worth start looking for alternatives to CHM? Maybe create and package a convenient web format that may be watched in a browser; Windows CHM viewer requires IE browser to work anyway.


Firefox shipped IO in 52

At TAG meeting, dbaron noted that IO will likely ship in FF52. If it does this update can go through.

Confirmed on MDN
https://developer.mozilla.org/en-US/docs/Web/API/Intersection_Observer_API#Browser_compatibility


Add unit tests based on study data

As we do this, I think we will want to implement truncated distributions for uncertain paired data in the case that a sampled curve is not monotonically increasing, and we will want to implement the less simple method.

two tests exist. of course more will be needed.


Reactive architecture

This change is

the framework must be hand in. This branch must be merged for my supervisor.


Loss of session data after log in

Hello everyone!
I'm afraid I have a problem that I'm not able to solve. You will see: I have a development in which I save data in the user's session before log in through SAML. Once I log in on the IdP successfuly, the session changes and I lose my important old data :(
I've made a sketch to show you what I want to achieve:

Before log in I have a sessionid with the value "kvdtu6ctgiau6oz8ru7qayokny733iag" (this session would have my data X, Y and Z). After successfully log in, I have a sessionid with the value "v5lkheyoqvfsxkclmt54g4pqyh2wwzoq", a session which the user's information from the IdP, but having lost all the data that was there before...
I have tested it with django 2.2.24 (project requisites...) and djangosaml2 v0.19, v0.40 and v1.0.0, all with the same result: the lost of the session old data.
Is this a feature? Do you know how I could keep my information safe and recover it after log in? Could I solve this with a djangosaml2 configuration?

We have a specialized cookie (samesite resistant) here
https://github.com/IdentityPython/djangosaml2/blob/master/djangosaml2/middleware.py
as we can read it, we use this cookie
https://github.com/IdentityPython/djangosaml2/blob/master/djangosaml2/views.py
here we authenticate the user after a succesfull saml2 authentication
https://github.com/IdentityPython/djangosaml2/blob/master/djangosaml2/views.py#L553
from that line to the like 577 you can inspect with a debugger what's wrong with your setup
let us know

One possible problem could be that SESSION_COOKIE_SECURE is not set to True by default in django. As djangosaml2 reuses this variable, by default the cookie will be sent with SameSite=None and Secure=False, leading to denial by recent browsers (you can check this in the Network-Tab of a Inspector for the ACS-Response).
I'd suggest a warning to be issued iff SESSION_COOKIE_SECURE is not set to True

This aspect is covered in the docs, here
https://github.com/IdentityPython/djangosaml2/blob/master/docs/source/contents/setup.rst#samesite-cookie
However I believe that your proposal is interesting, would you like to push a contribution and enable the warning message if the cookie is not secured?

I'm sorry to be late. 3 interesting weeks jejeje
Sadly, i couldn't debug the problem because the software i'm implementing is encapsulated on docker and i can't run it on local. I could attach to the process and debug it that way, but i tried other solution (that i will explain later) and it worked for now so was not needed.
Sadly, I couldn't debug the problem because the software I'm deploying is in a Docker container and I can't run it locally. I could attach my computer to the process and debug it that way, but I tried another solution (which I'll explain later) and it worked for now, so it wasn't needed.
First of all, I checked the code (djangosaml2/middleware.py) and everything seems fine. I didn't really find the problem this way. I thought maybe it was because I'm using an older version of djangosaml2, but I checked the same middleware in v1.0 and it seems the same...
I tried different settings: SESSION_COOKIE_SECURE was True and I had my own SAML_SESSION_COOKIE_NAME as the documentation explains, but it keeps losing data after the login.
In the end I decided to be creative; with the middleware code and some documentation from the internet (https://stackoverflow.com/questions/3862888/different-sessions-for-admin-and-applications-in-django) I created my own cookie where I save all the data I wanted to preserve after the login:
class CustomMiddleware(SessionMiddleware):

    def process_request(self, request):
        engine = import_module(settings.SESSION_ENGINE)
        session_key = request.COOKIES.get("my_custom_session_id", None)
        request.my_custom_session = engine.SessionStore(session_key)

    def process_response(self, request, response):
        try:
            accessed = request.my_custom_session.accessed
            modified = request.my_custom_session.modified
        except AttributeError:
            pass
        else:
            if accessed:
                patch_vary_headers(response, ('Cookie',))
            if modified or settings.SESSION_SAVE_EVERY_REQUEST:
                if request.my_custom_session.get_expire_at_browser_close():
                    max_age = None
                    expires = None
                else:
                    max_age = request.my_custom_session.get_expiry_age()
                    expires_time = time.time() + max_age
                    expires = cookie_date(expires_time)
                if response.status_code != 500:
                    request.my_custom_session.save()
                    response.set_cookie("my_custom_session_id",
                            request.my_custom_session.session_key, max_age=max_age,
                            expires=expires, domain=settings.SESSION_COOKIE_DOMAIN,
                            path=settings.SESSION_COOKIE_PATH,
                            secure=settings.SESSION_COOKIE_SECURE or None,
                            httponly=settings.SESSION_COOKIE_HTTPONLY or None)
        return response

That way, it worked for me; the sessionid of my_custom_session is not deleted and there are two cookies on the app: my_custom_session (where I can access all the data before and after the login) and the cookie defined in SAML_SESSION_COOKIE_NAME (where I have the login details of the user) .
If someone reading me has this problem, I solved it this way, but this is like killing a fly with a sledgehammer... Give me some time and I'll try in my spare time to replicate this problem in a simpler project to debug it, share it and find a better solution. I'm also sorry that I can't share the code for this project because it's a company software code and I can't share it.


Support rx/y=0 in fine_dehalo.mask

Useful for cases where you only want to dehalo in one direction (i.e. with lowpassed sources you can't freq merge).

Technically already "possible" by just making sure the dehaloing function itself only works in one direction.


Ghost "post" pages not responding

Issue Summary
I run an instance of ghost on my server and as stated in the title, the post pages do not send any data, leading ghost to cut the connection after 120s. The rest of the system works just fine (pages, admin, listing).
Environment:

Debian8
Ghost managed by supervisorctl
Apache proxy
Any Browsers (and probably any client OS too, but tried only Linux)

I already ruled out apache & supervisor by stopping my instance and starting it in the cli with npm and tried a curl on the localhost:2369 and the problem is the same, "post" pages wait and fail, others serves in millisecs
Logs are quiet… :(
In production:
Page timing out: https://www.melmelboo-voyage.fr/blog/2016/09/10/et-hop-dans-le-camion/
Page that doesn't: https://www.melmelboo-voyage.fr/blog/
I stopped the blog since it's issuing 301 to redirect everything to / which won't please referencement bots…
Technical details:
Ghost is running on the /blog path which seems to confuse it… it seems it issue redirects to / paths

Ghost Version: 0.11.1
Node Version: v0.10.29
Browser/OS: Debian8
Database: Sqlite3

Hum I missed configured stuffs with ssl & blog being under /blog path.
Not working yet (having 301 redirects everywhere, but not that problem…)


Documentation error

Page: https://zendframework.github.io/zend-navigation/quick-start/
Please, search string "'pages' => array(" and replace with "'pages' => ["

We have already a PR for this: #49


[Bug] [kompile] - makes it impossible to introduce fresh variables in requires clause

K Version
WARNING Incorrect version number. kompile is reporting 5.2.21, but it's actually 5.2.48 that I have checked out. I think the master branch is getting the incorrect version number when built locally.
$ kompile --version
K version:    v5.2.21-30-ga30a77c077
Build date:   Tue Dec 14 20:04:18 UTC 2021

Description
A rule needs to introduce a "don't care" variable in the requires clause, for ease of writing and understanding. For example:
       rule [call.getStorageAt]: //returns (uint256)
         <k> CALL _ TESTER_ACCT 0 ARGSTART _ARGWIDTH RETSTART RETWIDTH
          => #getStorageAt(#asWord(#range(LM, ARGSTART +Int 4, 32)), #asWord(#range(LM, ARGSTART +Int 36, 32)), RETSTART, RETWIDTH)
         ...
         </k>
         <localMem> LM </localMem>
         <testerAcctId> TESTER_ACCT </testerAcctId>
      requires #range(LM, ARGSTART, 4) ==K #signatureCallData("getStorageAt", #address(_), #uint256(_), .TypedArgs)
      [priority(40)]

We want to say that for any value of second/third arguments to #signatureCallData("getStorageAt", ...) such that the calculated signature is equal to #range(LM, ARGSTART, 4), the rule should apply. But we don't care about the particular values in the #address(_) or the #uint256(_), just their types.
Either using _ or ?_ as the variables there the backend complains. The ?_ is dis-allowed because it is considered an existential on the LHS of the rule. The _ is dis-allowed because it is considered an unbound variable on the RHS of the rule. So these two checks consider the LHS/RHS of the rule differently.
Input Files
File test.k
requires "domains.md"

module TEST
    imports INT
    imports BOOL

    configuration <k> $PGM:Foo </k>

    syntax Foo ::= "a" | "b"
 // ------------------------
    rule <k> a => b ... </k> requires ?_ ==Int _
endmodule

Reproduction Steps
$ kompile test.k --backend haskell --main-module TEST --syntax-module TEST
[Error] Compiler: Existential variable ?_ found in LHS. Existential variables
are only allowed in the RHS.
        Source(/home/dev/src/k/test.k)
        Location(11,39,11,41)
[Error] Compiler: Found variable _ on right hand side of rule, not bound on
left hand side. Did you mean "?_"?
        Source(/home/dev/src/k/test.k)
        Location(11,48,11,49)
[Error] Compiler: Had 2 structural errors.

Expected Behavior
This example should only give one structural error, for the ?_ on the LHS of the rule. The _ should not be considered to be part of the RHS of the rule for symbolic backends.

I have a suitable workaround for this.

I'm trying to understand what you mean in a more mathematical way.
Are you trying to say that "if exists X such that requires(X) then we have LHS => RHS" (or, equivalently, (exists X. requires(X)) and LHS => RHS)?
Or are you trying to say that "if forall X requires(X) then we have LHS => RHS"?
By looking at your wording, I think you mean the former, or something else entirely. However, the former might be fairly hard for backends to handle, since, in general, it is hard to figure out if there is a value that makes a predicate true (the reality is somewhat more nuanced).

Dwight: if you add this attribute unboundVariables(_) it should work.
Everett: I think this is still a bug.

Another work-around, say unboundVariables(_).


SAR PDF: Initiatives, Expenditures & Objectives

Description

This ticket covers the PDF generation for the initiative components in SAR. The Expenditure section needs a table to be generated so there's a new script called ExportEntityDetailsTable.tsx that handles that. Eventually we may want to consolidate some of the components for generating a table into its own util script.
Note:

There's some missing nested data for expenditure, will be address once the nested field is fixed.
I know coverage is low, I will cover it in another branch
Have at least one transition benchmark selected. @ntsummers1 found this bug caused by the R E & T tables where no transition benchmark selected will error out the pdf. I will address that in a separate branch

Related ticket(s)

CMDCT-3107
CMDCT-3106

How to test

Sign into MFP, any state user
Fill out a WP and submit
Sign out and login as admin user
Approve the previously submitted WP
Signout and sign back in as the state user
Create a SAR, and enter data for the Initiative section
Go to Review & Submit section, click Review PDF
Look to see that the PDF for Initiative section matches the mock ups: https://www.figma.com/file/oOJMUZerbafZefLQQ33GwI/MFP_Playground?type=design&node-id=2457-45591&mode=design&t=6GNcoOIopGRHuyAl-4

Important updates

Author checklist

[ ] I have performed a self-review of my code
[ ] I have added thorough tests, if necessary
[ ] I have updated relevant documentation, if necessary

convert to a different template: test → val | val → prod

This was a lot, looks good though! Karla already mentioned some styling things I came across but thats about it. Last time I spoke with Kim she mentioned the tables needing aria labels. Not sure when we should revisit that but seems like it should be its own ticket.

Noticed this when entering in some data for an expenditures

Also got an undefined title here for objectiveCards

Noticed this when entering in some data for an expenditures

I'm going to extract this one out to its own ticket since it requires a bit more of a structural change than what we currently have for displaying nested children


Can not enter text in search on RELP's (or when implementing in my own app)

On your demo site the search feature works as expected, allowing users to type in the input field, searching through the options in the list. In the REPL's of the same examples and in my app (a direct copy and paste of the examples) the components do not allow users to type/search at all.
(as of 12/28/22)
See a few examples of the current RELP's not working:
example 1⃣
example 2⃣
Repro
See above ☝
Steps to reproduce the problem (if needed to encounter error in StackBlitz):

Open demo site and try to type in the first example top search for more languages (working ✅)
Press the "REPL" button to go to the REPL site
Try typing into the input on the right in the demo area to add more languages (not working ❌)

Expected behavior
User should be able to type in the input to search the options to be added to the select/multi-select
Additional context
I have also uncounted this issue when trying to implement in my own projects, not only on the RELP but my project is a very simple implementation copied from the RELP and from the demo site so I suspect the issues are related.

 That's because the last CI release failed which @joelmukuthu alerted me to yesterday. So I made a local release and published that to NPM but forgot to stash some breaking local changes beforehand. In short, the v8.2.2 release is broken and should not be used. I deprecated it and made a new release v8.2.3. Please try that.

That seems to have worked, thanks for checking this out so quick! 10/10!!!


Fixing edge cases

Fixed issue where loading a new file wouldn't stop playback, and broke the player.
The play event will be handled in the ready callback, so if a new file is passed, don't call it here.

Thanks!


Android - Send Feedback Page

Open the default email application and prepare to send email to my address

https://github.com/smukov/AvI/commit/3882c476ebc99be06460d5404e8e187eb6a9653f


Publish command needs additional information

As shown, the publish command:
dotnet publish -f:net7.0-android -c:Release /p:AndroidSigningKeyPass=mypassword /p:AndroidSigningStorePass=mypassword
While only an example, still leaves the user confused because this command will fail with the error of not being able to fine the net7.0-android release.  The docs need to inform the user that the actual format is something like net7.0-androidNN.N where the NN.N is the API version and subversion, and the actual name will be the folder of that found under ./bin/Release for the project.

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 6b6c3b8a-6109-5ad5-ca05-fdaae8a9d66e
Version Independent ID: 6b6c3b8a-6109-5ad5-ca05-fdaae8a9d66e
Content: Use the CLI to publish for Android - .NET MAUI
Content Source: docs/android/deployment/publish-cli.md
Product: dotnet-mobile
Technology: dotnet-maui
GitHub Login: @davidbritch
Microsoft Alias: dabritch

Associated WorkItem - 89018

While only an example, still leaves the user confused because this command will fail with the error of not being able to fine the net7.0-android release. The docs need to inform the user that the actual format is something like net7.0-androidNN.N where the NN.N is the API version and subversion, and the actual name will be the folder of that found under ./bin/Release for the project.

Afraid that's not the case. I've published many Android apps using net7.0-android, which is the recommendation. Using .net7.0-android automatically picks the default for you, which is currently net7.0-android33.0.

While only an example, still leaves the user confused because this command will fail with the error of not being able to fine the net7.0-android release. The docs need to inform the user that the actual format is something like net7.0-androidNN.N where the NN.N is the API version and subversion, and the actual name will be the folder of that found under ./bin/Release for the project.

Afraid that's not the case. I've published many Android apps using net7.0-android, which is the recommendation. Using net7.0-android automatically picks the default for you, which is currently net7.0-android33.0.

Interesting.  I'll try again; maybe things have changed.  All I can tell you is this is the error I get if I do NOT explicitly use the 33.0


Add new repositories to the list

Dear awesome-utrecht-university,
I just learned about this repo and was wondering if you could add my projects to your list:
On my Github page (https://github.com/nielsjdewinter) I have three repo’s for the research code category:
nielsjdewinter/seasonalclumped (accompanying paper: https://cp.copernicus.org/articles/17/1315/2021/cp-17-1315-2021.html )
nielsjdewinter/DA_model (accompanying paper: https://doi.org/10.1016/j.palaeo.2019.109260)
nielsjdewinter/Aragonite_clumped (accompanying paper to be submitted)
I also developed one R package which seems to fit more within the “Research software” category:
nielsjdewinter/ShellChron (accompanying paper: https://gmd.copernicus.org/preprints/gmd-2020-401/)
Could you let me know if it is possible to add these repositories to the lists?
Thanks!
Niels de Winter
Dept. Earth Sciences

Dear Niels,
thanks for your message! I had a look at your repositories and would advise the following:

For seasonal clumped, Aragonite clumped, and ShellChron there is a nice readme, which is one of the contribution requirements, well done! If you would like to add the DA_model as well, it would be good to have a nice readme here as well.
Only Aragonite clumped has a license, which is another requirement. If you are unsure which one to use, you can take a look at this website for some information about this topic.
Lastly, while not necessary, it would be good to have citation information where it is applicable as well. Seeing how you have an accompanying paper for all repositories, I'd advise to add this to each repository as well.

Of course, we would be more than happy to help with these topics and again thank you for your interest!
On behalf of the FAIR Data and Software / Open Science Programme,
Keven Quach

Dear Keven,
Thank you for your feedback.
I have now added licences and citation files wherever these were missing.
All datasets except for "DA_model" should now be ready to be added to "awesome-utrecht-university".
Over the coming weeks, I will work on the README file for the "DA_model" and let you know when that is ready so it can be added as well.
Thanks again for the support and have a nice weekend!
Niels

One more thing I forgot: Could you add a description to your repositories? The description text of each repository is used in this list as well. That's an oversight on my end, sorry for that.

Nice contributions @nielsjdewinter :) I like the extensive READMEs and plots.
If you are interested in doing a PR, please let us know. Otherwise, @kequach will add the projects for you.

Thanks for your support @kequach, I just created a pull request adding names and descriptions of my repos to the list.
Note that I am not a very experienced GitHub user so I hope I did this the right way.
I did my best to follow the guidelines for the list and your suggestions, but please correct me if anything is out of order.
The only think I still need to do (I think) is add a proper README to the "DA_model" repo, I will do so as soon as possible.

@J535D165 Thanks for the nice compliment! :)
I would definitely be interested in doing some PR if you think my contributions would be interesting enough.
Actually, the paper for which I wrote the ShellChron model is being typeset at the moment and will be out soon.
Perhaps its release would be a good opportunity to do some PR on this repo.
The others are already somewhat older (publications from the previous years), but if you think they are an interesting subject I would be happy to work on a description for a broader audience.

@nielsjdewinter I checked your pull request. The commit looks good but you need to create the pull request in this repository, not in the fork you created. So this needs to be done here: https://github.com/UtrechtUniversity/awesome-utrecht-university/pulls
You can find information on how to create a pull request from a fork. A fork is a copy of a repository. You can see this from the URL: https://github.com/nielsjdewinter/awesome-utrecht-university
If you need further help, I'd be happy to assist. Except for this, everything looks good.

@kequach Sorry my bad, still didn't fully understand how it worked I guess. I now created a pull request for merging my fork with the main. Hope that will solve the issue and apply my changes to the main branch if you accept it. Please let me know if there is anything else I need to do.

@nielsjdewinter no worries, what we hope to achieve with this procedure is also helping you getting more familiar with these processes. Thanks again for your contributions!


wrong minimize

Do you want to request a feature or report a bug?
a bug

What is the current behavior?
for (let i = 0; i < l; i++) {
	const args = match.attrs[i];
	const value = args[3] || args[4] || args[5] || '';
	attrs[i] = {
		name: args[1],
		value: decodeAttr(value)
	}
}

r = r, will throw an exception TypeError: Assignment to constant variable.
for (let e = 0; e < o; e++) {
  const n = t.attrs[e],
  r = n[3] || n[4] || n[5] || "";
  a[e] = {
    name: n[1],
    value: (r = r, r.replace(_, "<").replace(g, ">").replace(m, "&").replace(b, '"'))
  }
}

If the current behavior is a bug, please provide the steps to reproduce.

What is the expected behavior?
for (let e = 0; e < o; e++) {
  const n = t.attrs[e],
  r = n[3] || n[4] || n[5] || "";
  a[e] = {
    name: n[1],
    value: (r.replace(_, "<").replace(g, ">").replace(m, "&").replace(b, '"'))
  }
}

If this is a feature request, what is motivation or use case for changing the behavior?
Please mention other relevant information such as the browser version, Node.js version, webpack version, and Operating System.
OS: Debian
Node.js 9.6.1
webpack version: 4.0.1 4.0.0-beta.3

What is decodeAttr? Why is it replaced? Could you create a repository to reproduce the issue?

Already asked/answered. Search issues before reporting a bug.
https://github.com/webpack/webpack/issues?q=is%3Aissue+TypeError%3A+Assignment+to+constant+variable+is%3Aclosed

This is the related issue: https://github.com/webpack/webpack/issues/6567. Took me ages to figure out, since its title refers to a feat request.


Remove: Discord.Discord.Development version 1.0.658

## .\Tools\YamlCreate.ps1 -SkipPRCheck -Mode 5 -PackageIdentifier Discord.Discord.Development -PackageVersion 1.0.658

[X] Have you signed the Contributor License Agreement?
[X] Have you checked that there aren't other open pull requests for the same manifest update/change?

[X] Does your manifest conform to the 1.0 schema?

Microsoft Reviewers: Open in CodeFlow

/azp run


Using extract="outerHtml]" in a domTagger's fields leads to no error!!

I just ran the following simple crawler:
<?xml version="1.0" encoding="UTF-8"?>

<!-- Testing crawler for Attribute extraction -->

<httpcollector id="Testattribute">

  <!-- Decide where to store generated files. -->
  <progressDir>./tests-output/testattribute/progress</progressDir>
  <logsDir>./tests-output/testattribute/logs</logsDir>

  <crawlers>
    <crawler id="Testattribute">

<!--
      <robotsTxt ignore="true" />
      <userAgent>Please identify your Crawler</userAgent>
      <numThreads>1</numThreads>
      <keepDownloads>false</keepDownloads>
        <preParseHandlers>
          <filter class="com.norconex.importer.handler.filter.impl.RegexMetadataFilter"
                  onMatch="include" field="document.reference" >
            http://avax\.news/fact/The_Day_in_Photos_June_16_2016\.html
          </filter>
        </preParseHandlers>
          <tagger class="com.norconex.importer.handler.tagger.impl.TextPatternTagger"
                  caseSensitive="true"
                  sourceCharset="UTF-8">
            <pattern field="isrc" group="1">
              <img *.*src="([^"]+)".*>
            </pattern>
          </tagger>
-->

      <startURLs stayOnDomain="true" stayOnPort="true" stayOnProtocol="true">
        <url>http://avax.news/fact/The_Day_in_Photos_June_16_2016.html</url>
      </startURLs>

      <workDir>./tests-output/testattribute</workDir>

      <maxDepth>0</maxDepth>  <!-- TODO: Set to 2??? -->

      <!-- We know we don't want to crawl the entire site, so ignore sitemap. -->
      <!-- Since 2.3.0: -->
      <sitemapResolverFactory ignore="true" />

      <!-- Be as nice as you can to sites you crawl. -->
      <delay default="5000" />

      <referenceFilters>
        <filter class="com.norconex.collector.core.filter.impl.RegexReferenceFilter" onMatch="include">
          http://avax.news/fact/The_Day_in_Photos_June_16_2016.html
        </filter>
      </referenceFilters>

      <!-- Document extraction/manipulation -->
      <importer>
        <postParseHandlers>
          <tagger class="com.norconex.importer.handler.tagger.impl.KeepOnlyTagger">
            <fields>document.reference</fields>
          </tagger>
          <tagger class="com.norconex.importer.handler.tagger.impl.DOMTagger">
            <dom selector="a>img" toField="IMAGE"
                 overwrite="true"
                 extract="outerHtml" />
          </tagger>
        </postParseHandlers>
      </importer>

      <committer class="com.norconex.committer.core.impl.FileSystemCommitter">
        <directory>./tests-output/testattribute/crawledFiles</directory>
      </committer>

    </crawler>
  </crawlers>

</httpcollector>

Output was:
INFO  [SitemapStore] Testattribute: Initializing sitemap store...
INFO  [SitemapStore] Testattribute: Done initializing sitemap store.
INFO  [HttpCrawler] 1 start URLs identified.
INFO  [CrawlerEventManager]           CRAWLER_STARTED
INFO  [AbstractCrawler] Testattribute: Crawling references...
INFO  [CrawlerEventManager]          DOCUMENT_FETCHED: http://avax.news/fact/The_Day_in_Photos_June_16_2016.html
INFO  [CrawlerEventManager]       CREATED_ROBOTS_META: http://avax.news/fact/The_Day_in_Photos_June_16_2016.html
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/search?q=50+first+dates+720p
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/search?q=bones+s08e02
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/fact/The_Day_in_Photos_June_16_2016.html
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/search?q=graphics
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/search?q=white+tiger
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/search?q=child+44+2015+720p
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/search?q=phtographers+waves
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/search?q=SLAVERY%2BPLANTATION
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/sad
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/educative
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/search?q=chillar+party+movie
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/touching
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/search?q=anal%2Bcollection
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/admin/news/11630/edit
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/ohlala/disclaimer
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/assets/logo-d9927e7b6d62c2ea2a394f6a13eddbde.png
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/wow
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/about_us.html
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/funny
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/search?q=feria+de+abril
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/search?q=hard+west
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/search?q=need+for+speed+most+wanted
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/tags_cloud
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/search?q=parade+
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/search?q=victoria+secret
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/disgusting
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/charming
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/search?q=jack+nicholson
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/search?q=child%2Bfuck
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/fact/The_Day_in_Photos_June_16_2016.html#disqus_thread
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/search?q=cargo
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/search?q=WW+I
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/search?q=beautiful+babes
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/tags/Pictures%20of%20Recent%20Events
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/search?q=snue
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/search?q=star+wars+revenge
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/search?q=lovers+and+friends
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/search?q=Baliem+Valley+Festival
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/users/sign_in
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/search?q=friends+9
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/search?q=rhythmic+gymnastic
INFO  [CrawlerEventManager]         REJECTED_TOO_DEEP: http://avax.news/fact
INFO  [CrawlerEventManager]            URLS_EXTRACTED: http://avax.news/fact/The_Day_in_Photos_June_16_2016.html
INFO  [CrawlerEventManager]         DOCUMENT_IMPORTED: http://avax.news/fact/The_Day_in_Photos_June_16_2016.html
INFO  [CrawlerEventManager]    DOCUMENT_COMMITTED_ADD: http://avax.news/fact/The_Day_in_Photos_June_16_2016.html
INFO  [AbstractCrawler] Testattribute: Re-processing orphan references (if any)...
INFO  [AbstractCrawler] Testattribute: Reprocessed 0 orphan references...
INFO  [AbstractCrawler] Testattribute: Crawler finishing: committing documents.
INFO  [AbstractCrawler] Testattribute: 1 reference(s) processed.
INFO  [CrawlerEventManager]          CRAWLER_FINISHED
INFO  [AbstractCrawler] Testattribute: Crawler completed.
INFO  [AbstractCrawler] Testattribute: Crawler executed in 2 seconds.
INFO  [JobSuite] Running Testattribute: END (Fri Jun 17 17:12:34 CEST 2016)

There is no error in the logs, even if the extract field is wrong??!!
By the way, even after correcting this mistake, this crawler does not seem to work (crawledFiles/xxx/xxx.cntnt contains the whole page as text instead of an IMAGE tag, xxx.meta and xxx.ref are OK the document reference). Do you have a hint where I'm mistaking?

About the content:
Taggers do not modify the content, just the fields/metadata.  Looking at your config, the HTML will be parsed normally and it is expected for you to get the content.   "Transformers" will modify the content if that's what you want.
About the image tag you do not have... it is also normal since you have your DOM tagger as a POST-parse handler.  Once parsing occured, the original document is gone and you are left with plain text (it is no longer an HTML document).
To work with a DOMTagger you have to follow the advice in its documentation "Should be used as a pre-parse handler."  Give that a try, but make sure you do not put your KeepOnlyTagger after or that will get rid of your IMAGE field.
Also, since the config file is XML, in case this makes a difference I would suggest you escape your angle bracket: selector="a>img".
The metadata/fields are stored in a .meta file when you use the FileSystemCommitter.  Are you using the FileSystemCommitter just to troubleshoot for now?  Because once you are satisfied with your crawler config, it is highly recommended you use your own committer instead (to avoid needing a separate process that reads those files).

Do you still have questions/issues related to this ticket or can we close?
FYI, a new snapshot release of HTTP Collector was made with an updated Importer module in it.  It gives DOMTagger  more options.

Hi,
Sorry I had to switch to another task and I'm coming back to this one only now.
Thanks for the explanations. It appears that I'm still lacking a lot of understanding of the inner working of the tool (particularly the pre/post handlers, when is HTML/text handled, and Taggers/Transformers differences...). That's what comes with learning while doing...
Whatever, I quite like the way Norconex's collector is designed (particularly with respect to Heritrix): it seems to rely on the composition of simple elements, which is more in the KISS/Unix way of designing/using tools and allows more flexibility & modularity, at the same time as keeping small and human-readable config files...
Yes, I'm using FileSystemCommitter for the moment to "get my grips" on the tool, but I'll of course implement a specific committer when I'll need to put our crawlers in production.

Thanks for the good feedback!  While sometimes difficult to apply, KISS/flexibility/modularity are indeed very important design drivers to us.   I am glad you recognise that.


FEAT: test action scripts using testing actions

This pull-request introduces a testing job in the CI. It allows to test the different scripts collected in the scripts/ directory using the actions implemented in #42. This also has the advantage of testing the action itself.

I really like the new script for updating the versions.json fie ❤

Still looking for a way to test this within our actions. The problem is that this is not a package but a script.

Let me add one last change that @Revathyvenugopal162 asked for some days ago. That is having a "(stable)" not after the last stable release.

Great! Now the script is able to add the X.Y (stable) tag to the latest stable release in the project in a dynamic way.