HADOOP-18917. Addendum. Fix deprecation issues after commons-io upgrade.

Description of PR
HADOOP-18917 - fix deprecation warnings after commons-io 2.14.0 upgrade
How was this patch tested?
For code changes:

[x] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
[ ] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
[ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
[ ] If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

:broken_heart: -1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
18m 12s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  0s

codespell was not available.

+0 :ok:
detsecrets
0m  0s

detect-secrets was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 4 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
15m 34s

Maven dependency ordering for branch

-1 :x:
mvninstall
38m 33s
/branch-mvninstall-root.txt
root in trunk failed.

+1 :green_heart:
compile
18m 34s

trunk passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
compile
16m 50s

trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
checkstyle
4m 41s

trunk passed

+1 :green_heart:
mvnsite
2m 54s

trunk passed

+1 :green_heart:
javadoc
2m 35s

trunk passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
javadoc
3m  1s

trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
spotbugs
5m 19s

trunk passed

+1 :green_heart:
shadedclient
38m 49s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 29s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
1m 54s

the patch passed

+1 :green_heart:
compile
18m 26s

the patch passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
javac
18m 26s

the patch passed

+1 :green_heart:
compile
17m 59s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
javac
17m 59s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

+1 :green_heart:
checkstyle
4m 40s

the patch passed

+1 :green_heart:
mvnsite
3m  0s

the patch passed

+1 :green_heart:
javadoc
2m 31s

the patch passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
javadoc
3m  7s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
spotbugs
7m 14s

the patch passed

+1 :green_heart:
shadedclient
47m 10s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

-1 :x:
unit
1m  1s
/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
hadoop-hdfs in the patch failed.

-1 :x:
unit
1m  5s
/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt
hadoop-yarn-server-applicationhistoryservice in the patch failed.

+1 :green_heart:
unit
2m  2s

hadoop-archive-logs in the patch passed.

+1 :green_heart:
asflicense
1m 29s

The patch does not generate ASF License warnings.

286m 50s

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6228/1/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/6228

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets

uname
Linux 7dd7fd18a848 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / 7416fb2efd14d2ea30ade2c10f7e0ce5af3af89f

Default Java
Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6228/1/testReport/

Max. process+thread count
536 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice hadoop-tools/hadoop-archive-logs U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6228/1/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

:confetti_ball: +1 overall

Vote
Subsystem
Runtime
Logfile
Comment

+0 :ok:
reexec
1m 19s

Docker mode activated.

_ Prechecks _

+1 :green_heart:
dupname
0m  0s

No case conflicting files found.

+0 :ok:
codespell
0m  2s

codespell was not available.

+0 :ok:
detsecrets
0m  2s

detect-secrets was not available.

+1 :green_heart:
@author
0m  0s

The patch does not contain any @author tags.

+1 :green_heart:
test4tests
0m  0s

The patch appears to include 4 new or modified test files.

_ trunk Compile Tests _

+0 :ok:
mvndep
16m 33s

Maven dependency ordering for branch

+1 :green_heart:
mvninstall
36m 59s

trunk passed

+1 :green_heart:
compile
18m 16s

trunk passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
compile
16m 41s

trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
checkstyle
4m 38s

trunk passed

+1 :green_heart:
mvnsite
3m 49s

trunk passed

+1 :green_heart:
javadoc
3m 32s

trunk passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
javadoc
4m  2s

trunk passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
spotbugs
7m 12s

trunk passed

+1 :green_heart:
shadedclient
38m 48s

branch has no errors when building and testing our client artifacts.

_ Patch Compile Tests _

+0 :ok:
mvndep
0m 28s

Maven dependency ordering for patch

+1 :green_heart:
mvninstall
2m 29s

the patch passed

+1 :green_heart:
compile
17m 39s

the patch passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
javac
17m 39s

the patch passed

+1 :green_heart:
compile
16m 44s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
javac
16m 44s

the patch passed

+1 :green_heart:
blanks
0m  0s

The patch has no blanks issues.

+1 :green_heart:
checkstyle
4m 33s

the patch passed

+1 :green_heart:
mvnsite
3m 44s

the patch passed

+1 :green_heart:
javadoc
3m 56s

the patch passed with JDK Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04

+1 :green_heart:
javadoc
4m  5s

the patch passed with JDK Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

+1 :green_heart:
spotbugs
7m 52s

the patch passed

+1 :green_heart:
shadedclient
38m  7s

patch has no errors when building and testing our client artifacts.

_ Other Tests _

+1 :green_heart:
unit
235m 35s

hadoop-hdfs in the patch passed.

+1 :green_heart:
unit
5m 51s

hadoop-yarn-common in the patch passed.

+1 :green_heart:
unit
4m 52s

hadoop-yarn-server-applicationhistoryservice in the patch passed.

+1 :green_heart:
unit
1m  8s

hadoop-archive-logs in the patch passed.

+1 :green_heart:
asflicense
1m  4s

The patch does not generate ASF License warnings.

510m 41s

Subsystem
Report/Notes

Docker
ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6228/2/artifact/out/Dockerfile

GITHUB PR
https://github.com/apache/hadoop/pull/6228

Optional Tests
dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell detsecrets

uname
Linux 3df98466a6d0 4.15.0-213-generic #224-Ubuntu SMP Mon Jun 19 13:30:12 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Build tool
maven

Personality
dev-support/bin/hadoop.sh

git revision
trunk / e53d1b1b13dda34bcd92042f0f61238395656366

Default Java
Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Multi-JDK versions
/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-<IP_ADDRESS>+1-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_382-8u382-ga-1~20.04.1-b05

Test Results
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6228/2/testReport/

Max. process+thread count
2433 (vs. ulimit of 5500)

modules
C: hadoop-hdfs-project/hadoop-hdfs hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice hadoop-tools/hadoop-archive-logs U: .

Console output
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6228/2/console

versions
git=2.25.1 maven=3.6.3 spotbugs=4.2.2

Powered by
Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

@ayushtkn this tidies up the commons-io deprecation issues on trunk. I have the same changes in the https://github.com/apache/hadoop/pull/6151


Automatically build notification_setting if user doesn't have one yet

Is your feature request related to a problem? Please describe.
The Readme has this example:
s = User.first.notification_setting
s.settings[:enabled] = false

But when I tried this example after adding notification-settings to an existing project, I got this error instead:
main > s = User.first.notification_setting
=> nil

main > s.settings[:enabled] = false
NoMethodError: undefined method `settings' for nil:NilClass

Describe the solution you'd like
It would be nice if a settings target/object could safely assume that it always has an associated notification_setting.
It looks like this callback was added in order to help ensure that a  notification_setting always exists for new users:
before_create :create_notification_setting

... but that doesn't help in the case of pre-existing user records.
I propose (instead of that) overriding notification_setting such that it builds a new setting if one doesn't already exist:
      def notification_setting
        super || build_notification_setting
      end

I've tried it locally and it works fine...
Describe alternatives you've considered
Update the migration generator to create settings records for any existing [user] records.

Would you be willing to submit a pull request?

Sure! Submitted #40...


WIP - Add error highlighting using HTML examples

This PR replaces https://github.com/alphagov/govuk-frontend/pull/494 with a better approach which is to build the examples in markup before getting into how we handle nesting etc. with the component APIs.
It:

Adds another CSS variable for error border to settings
Adds a form group which can be used to group related form items together and show errors for those. For now I’m treating it as part of core styles but we might want to make it a component…
Adds error styling for fieldsets
Makes checkbox and radios containers the height of children - @alex-ju, I’m aware you had some concerns about this approach. The issue is that the radios/checkboxes are absolutely positioned. We can’t adjust the line height of the text next to them to match the checkboxes height as the text might wrap. Instead we’re using padding to vertically centre the content which throws it off by a pixel or so. For that reason setting the height of the parent which can’t “see” the height of the absolutely positioned content inside fixes this (I know this a bit rambly, happy to talk about this in the office if I’m not making sense 🙂  )
Adds an outer wrapper to input and select which now contains the bottom margin. I’ve called the elements themselves govuk-c-input__input to mirror govuk-c-date-input__input but open to discussion on this.
Adds examples to preview app in examples/error-messages

I used overrides to remove button margin (last two examples) as it doesn’t feel right to handle button margins in the form-group styles, having buttons inside form-groups seems like a bit of an edge case. But open to thoughts on this.
Note: Please review in /examples/error-messages. It might be easier to look at the commits which separate the work out into smaller chunks. This PR doesn't update any component macros or previews, or any READMEs and component argument tables as I’d like to settle on an approach first before tackling all those.
Optional reading, not related to this PR: If you view the page on mobile, there is an issue with margins in the last example. We remove the bottom margin of last-of-type on radios and checkboxes but if you place the item inside a grid item for instance, that rule will apply to all of them and on mobile this is an issue when things stack. I’ll raise another PR for this once I've spoken to @dashouse .
https://trello.com/c/ioB6wNUq/670-5-add-highlighting-of-errors-to-form-components

I had an in-person review of this with @hannalaakso earlier today (she kindly walked me through it). My take is that if we're going to use a form-group approach, because the form-group is essentially a wrapper I would define it as .govuk-o-form-group at a global level, as we already have all the wrappers as objects, then I'll use a single modifier .govuk-o-form-group--error to throw that error to all components.
Using this wrapper means we don't need additional nesting (e.g. govuk-c-input__input) and we don't have to define the --error for each component. Also this can potentially help us with conditional revealed content, by using it with a modifier (e.g. .govuk-o-form-group--revealed).
I can elaborate or add comments on specific lines, but being more about the approach I felt like I shouldn't hijack the review process.

Thanks @alex-ju. I think your approach makes sense 👍  I've amended the markup so that now everything uses form-o-group for displaying error messages. I've made it into an object as we have other wrappers in objects. Making form-group into a component means that literally the only argument it would be take would be classes so having it as a component seems like extra complexity for not much gain.
I spoke to @joelanman about use cases and he thinks having an errored field while highlighting the connected fields is not a thing:

He thinks only the fields that have errors in them should be highlighted, in this case the street. If there are multiple errors each of them should have a separate highlight. @dashouse agrees however he wants to do some digging around to see if there are exceptions.

Don't disagree with @joelanman, reason for allowing it to happen (even if not promoted) were:
Existing group errors, for example:

In-line input errors
Any group of inputs that are inline (but not a component)...for example
Telephone number
[+44] [7875693355]

What are our definitions for using component Vs objects? It's important we are consistent, we have lots of components that only have 'classes' and 'text'.

@nickcolley I guess objects act as wrappers for things and don't style the containing content (like govuk-c-error-message does which changes the colour of the containing text). In this definition,  govuk-o-grid and govuk-o-width-container are objects. govuk-c-fieldset is a wrapper but it contains a legend within it so it's no longer only a wrapper.

I've added the markup to macros (three latest commits) so this PR is now ready to review.
I'll rebase the commits before merging.

@dashouse again, in that login example, do you really need it grouped? It seems very uncommon to have to highlight both being blank like this. I think two errors would be ok?
Also I think both inputs should be highlighted red to be consistent with our error styles.

@joelanman I'm not sure what the conversation actually is here. I believe it's the same container whether you wrap it around one input or a group of inputs. So if this is more about what we present as best practice I agree absolutely...that example shouldn't be in the design system.
I just wouldn't want to somehow block using it on groups, just because of the unknowns about what it might need to be used for...

Think we'll need to squash the git commits to make the history easier to follow before we can merge.

Pages to review:

Error messages
File upload
Date input
Checkboxes
Fieldset
Input
Radios
Select
[Textarea](https://govuk-frontend-review-pr-519.herokuapp.com/components/textarea#heading-textarea--with error message)

I've squashed the commits. Note that if you view the order of commits on Github, they don't seem to be in the most logical order as I rebased multiple time but if you do git log they are in the right order.

Thanks @nickcolley 🎉 (Just to confirm: the date-input bug you picked up on is now fixed)

Well done @hannalaakso :)

Thank you @joelanman, a lot of sweat and tears went into this one 😅


[Feature Request] Freely move tabs at the left sidebar

VSCode Version: 1.18.0
OS Version: Windows 10 Pro

Requesting new feature:
What I hope it could do: Allow tabs at the left sidebar section to scale and move up and down
What it is doing now: Click the tab, and then it expands with fixed height (which require some trick to expand it to larger by expanding tabs below it then retract them back), if multiple tabs were expanded before retracting, retracting them all is feeling kind of weird.

@ThisTNTSquid Do you mean to move tabs when they are all collapsed?

Both closed and expanded, just like separated expansion cards, you could move them and rearrange them

Perhaps I overlooked it, it is actually already here


Update SerialPort to v10, fixing several breaking changes. I need a hand with tests.

IMPORTANT: This doesn't currently pass tests due to how SerialPort.list
gets mocked. I'm having a hard time understanding the correct way to
fix the mocking library.
SerialPort 10 is dramatically easier for Electron apps to bundle. I'd really love to get avrgirl-arduino updated to work with it.
Manual testing seems to indicate that the changes work, including the behaviour that's failing tests. It looks like there's a dep issue with avrga-tester that's blocking my ability to run through the test-pilot process. I'm really sorry about that :/

Signed-off-by: Jesse Vincent<EMAIL_ADDRESS>Description
Please review the contribution and code of conduct guidelines.
Please include a summary of the proposed improvement or addressed issue.
Fixes/addresses (If applicable) # (issue)
Type of change
Please delete options that are not relevant.

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

Checklist:

[ ] My code follows the style guidelines of this project
[ ] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[ ] New and existing unit tests pass locally with my changes
[ ] Any dependent changes have been merged and published in downstream modules
[ ] Changes have been manually tested (please provide information on test platform using the fields below)

Test / Development Platform Information

Operating system and version
Avrgirl Arduino version
NodeJS version
Arduino Board being used

@noopkat this is as much a request for feedback as anything else. When you have the time, I'd love to know whether this is something to push on or not.


Couldn't find package "<EMAIL_ADDRESS>

Latest release not work.
Yarn Install emit this warning.
Couldn't find package "<EMAIL_ADDRESS>required by "<EMAIL_ADDRESS>on the "npm" registry.

Hi, @andreatosato
The "<EMAIL_ADDRESS>hasn't publish to npm registry now. You can find it in https://botbuilder.myget.org/feed/botbuilder-declarative/package/npm/@bfcomposer/bf-lu
If you want to yarn install the composer, the yarn.lock can't be deleted.

Hi @lei9444, yarn.lock isn't present in path.
I download project now and file is present.
Now build correctly


feat(compute): Add Zonal MIG example

Description
Fixes #216660865
Note: If you are not associated with Google, open an issue for discussion before submitting a pull request.
Checklist
Readiness

[X] Yes, merge this PR after it is approved
[ ] No, don't merge this PR after it is approved

Style

[X] My sample follows the rules described for Terraform in the Effective Samples style guide
[X] My sample follows the other requirements and best practices in the Contributing
guide

Testing

[X] I have performed tests described in the Contributing guide:

[X] Tests pass: terraform apply
[X] Lint pass: terraform fmt check

Intended location

[X] Yes, this sample will be (or already is) included on cloud.google.com
Location(s): https://cloud.google.com/compute/docs/instance-groups/create-zonal-mig

[ ] No, this sample won't be included on cloud.google.com
Reason:

API enablement

[X] If the sample needs an API enabled to pass testing, I have added the service to the Test setup file

Review

[X] If this sample adds a new directory, I have added codeowners to the CODEOWNERS file

/gcbrun
Invoking CICD tests.

/gcbrun


Update LEAP hub images to latest pangeo image

This brings in a new dask-gateway version to match what we have in the chart, which might help with some of the issues the LEAP users have been facing.
This also brings in a newer version of JupyterLab, which requires we stop using NotebookApp. This overrides it for this specific hub until
https://github.com/2i2c-org/infrastructure/pull/2160 is merged.
Ref https://2i2c.freshdesk.com/a/tickets/433

This has unblocked @jbusecke, so I'm going to just merge this now so it doesn't accidentally get undone. Hopefully the need to merge without review will be reduced going forward as our engineering capacity grows!


Work around Visual Studio bug inferring type of auto

https://connect.microsoft.com/VisualStudio/feedback/details/3121204/visual-studio-reports-cannot-deduce-auto-type-for-an-auto-despite-msvc-successfully-compiling-the-code
Although ProtocolConformance.cpp is part of the runtime, so must be built with Clang, Visual Studio (not MSVC) reports "cannot infer type of auto" errors, severely limiting it's ability to provide a good IDE experience for any compiler.

@swift-ci please smoke test

@swift-ci please smoke test

@swift-ci please smoke test

@swift-ci please smoke test

@swift-ci please smoke test

@swift-ci please smoke test

@gparker42 you happy with this? I think const auto is the best we can do here

Friendly ping, should be a simple set of changes :)

Looks good. const auto is a better disambiguator than auto * IMO.


Set shards and replicas settings for index creation

Hi,
This PR is intended to give the option to set shards and replicas for the elastalert index creation, this could be useful in environments with one elasticsearch node.
Best Regards

For anyone interested, here is an updated diff: https://gist.github.com/eht16/135e3e3e21d5a0506a909febf574fd07
I think this would be a useful addition. For example, my use case is also a one-node ES cluster so I don't need replicas and for rather small indices I prefer only one or two shards.

I agree, this would be nice to have. In my case, there is no need for extra 4 primary shards taking up resources.
@eht16 Cheers for the diff :)

Any reason why this wasn't merged?

Can you resolve conflicts please :)

Can you resolve conflicts please :)


selecting items that have "ALL" selected tags

Hi,
I'm evaluating django-taggit but I can't see a simple way to select items that have all selected tags. I can't at the moment find a simple solution using django ORM eather. I know django-tagging has with_all (and with_any counterparts) but the implementation uses a SELECT IN that can be huge (and so very inefficent) when number of items/tags grow.
thanks in advanced for any hint
sandro
*:-)

I provide an example of how to do this in #680, but we'll try and document this a bit more

I want to solve this issue,if this issue is still opened @sandroden   , and kindly provide require details before working on this issue

Given its 9 years ago there's probably not as much of a need from that person in particular but give it a shot! Maybe propose an API, or outright write up a PR and we can iterate on it


[FEA] Support date cast and date_sub as AST expressions

I wish we can support Left Semi + BNLJ.
eg:
import org.apache.spark.sql.Row
import org.apache.spark.sql.types._
import spark.sqlContext.implicits._
import org.apache.spark.sql.functions._

val data = Seq(
    Row(Row("Adam ","","Green"),"1","M",1000),
    Row(Row("Bob ","Middle","Green"),"2","M",2000),
    Row(Row("Cathy ","","Green"),"3","F",3000)
)

val schema = (new StructType()
  .add("name",new StructType()
    .add("firstname",StringType)
    .add("middlename",StringType)
    .add("lastname",StringType))
  .add("id",StringType)
  .add("gender",StringType)
  .add("salary",IntegerType))

val df = spark.createDataFrame(spark.sparkContext.parallelize(data),schema)
val df2 = df.withColumn("dt",current_date().as("dt")).withColumn("ts",current_timestamp().as("ts"))

df2.printSchema
df2.write.format("parquet").mode("overwrite").save("/tmp/testparquet")
val newdf2 = spark.read.parquet("/tmp/testparquet")
newdf2.createOrReplaceTempView("df2")

val query="""
select count(*) as cnt
from df2 a left semi join
df2 b on date(a.ts) > b.dt - 7
"""

spark.sql(query).collect

Not-supported-messages:
        !Exec <BroadcastNestedLoopJoinExec> cannot run on GPU because not all expressions can be replaced
          @Expression <GreaterThan> (cast(ts#127 as date) > date_sub(dt#253, 7)) could run on GPU
            !Expression <Cast> cast(ts#127 as date) cannot run on GPU because AST is required and this expression does not support AST
              @Expression <AttributeReference> ts#127 could run on GPU
            !Expression <DateSub> date_sub(dt#253, 7) cannot run on GPU because AST is required and this expression does not support AST
              @Expression <AttributeReference> dt#253 could run on GPU

This request is more about asking cast-as-date and date_sub to be supported as AST expressions than the join itself.  If those were supported by AST then the join would have been on the GPU.

Note if this issue is resolved, then the integration test used in #7037 will need to be updated as it currently relies on this running on the CPU (an unfortunate limitation of the testing scenario involved).

I think we need to be clear about a lot of what is being asked here.  Casting a timestamp to a date is complex, especially if a timezone is involved.
https://github.com/NVIDIA/spark-rapids/blob/a056f162bf1fe21d8e3ce58b646bc791f419210a/sql-plugin/src/main/scala/com/nvidia/spark/rapids/GpuCast.scala#L628-L633
But even without a timezone it is not likely to ever be an AST operation.  Date differences, however, should be a subtraction operation.
https://github.com/NVIDIA/spark-rapids/blob/a056f162bf1fe21d8e3ce58b646bc791f419210a/sql-plugin/src/main/scala/org/apache/spark/sql/rapids/datetimeExpressions.scala#L1241
So putting that in AST should be super simple to do, if we can get CUDF to ignore the logical type and just look at the physical type of the data.
That said I think the simplest thing for us to do to be able to support complex operations is to finish https://github.com/NVIDIA/spark-rapids/pull/9635
It added in some basic support for rewriting joins so part of it is on the AST and other parts are not. But it only did it for a BroadcastNestedLoopJoin. We really should just extend that out to all join types and do some performance testing to see how well it performs.

Note: I tested the original query in this issue and it works now on GPU.
I will keep this issue open as discussed.
In the meantime, I opened 2 related FEAs based on a customer's fallback messages:
https://github.com/NVIDIA/spark-rapids/issues/11213
https://github.com/NVIDIA/spark-rapids/issues/11214


Space wasted in search bar

Much of the search bar is being wasted (left side). On the other hand, if the feed has a huge description, part thereof is 'cut' from the search bar (right side).
See image below.

@miguelarauj1o what layout are you using? I can't reproduce this :frowning:

I can confirm this on my setup with default view and filter bar active.
OS X 10.10 using latest Vienna 3.0.6.

I also see the problem. Might be a centered alignment problem.

@josh64x2, horizontal. OS X 10.10.4 using latest Vienna 3.0.6.

I looked into this. The issue is that the NSSearchField does not perform layout when its cell's placeholder string is changed, which happens when a new folder is selected.
I was thinking this could be solved by simply calling setNeedsLayout on the search field, but, unfortunately, NSSearchField animates its contents when it loses focus, so setNeedsLayout causes a visual hiccup.
I think this will be tricky to solve given the public interface to NSSearchField. A workaround would be to have the filter field simply read "Filter," like the search fields in Finder, Mail, etc.

So weird. I still can't reproduce this and my search fields in Finder and Mail both say "Search" not "Filter".
:confused:

Right, the Finder and Mail search fields say "Search." I just meant that you could use a single word ("Filter") that doesn't change with the search scope.
To repro, show the filter bar, then select a folder/feed with a short name, then one with a long name.

Ahh excellent, thanks!


Add davidjiang007's file

created a branch, created a file and made a commit, and opened a pull request

This one is great, thanks for the contribution.

This one is definite something.


Support relative path

Hi developit , I think it should support relative path, 谢谢 ^ ^

I agree! I believe this was being worked on.

This is still being worked on?


The upper limit of Semi-Supervised Learning is mainly restricted to the quality of augmented data?

Do you think so?
Thank you very much! @carlini

I don't think we have a good answer to this question. This is a good research question that would be interesting to study, but probably isn't a bug.


Android Basics: Fragments Navigation component

URL of codelab
https://developer.android.com/codelabs/basic-android-kotlin-training-fragments-navigation-component#0
In which task and step of the codelab can this issue be found?

Before you begin

Describe the problem
In the sentence: "In the example below, both the navigation UI on the left and the content on the right can each be contained in a separate fragmen." the last word is missing a "t" at the end.
Steps to reproduce?
As stated above.
Versions
Not applicable.
Additional information
Nil.

@KKH-tw
Thank you so much for reporting this issue. This is fixed and will be published soon.


Rename the dom-module id for vaadin-password-field

I can't see any reason that <dom-module id="vaadin-password-field-template"> shouldn't be the more logical <dom-module id="vaadin-password-field">. Keeping the id in sync with the module name and is() method is what occurs in the other Vaadin elements I looked at. Having them different can also mess with code completion in IDEs like the JetBrains suite which use the id.

I assume it’s because password field is extending the template of text field, and its own template contains only the extra pieces that are added to the text field’s template.
I quickly tested this out (removed the -template suffix), and that broke at least on Safari.

That's correct. Here's where the element picks the pieces from the template https://github.com/vaadin/vaadin-text-field/blob/master/vaadin-password-field.html#L117

That's correct. Here's where the element picks the pieces from the template https://github.com/vaadin/vaadin-text-field/blob/master/vaadin-password-field.html#L117

In the docs there's no + '-template' part.
This is a restriction that AFAIK comes from the combination of themable-mixin https://github.com/vaadin/vaadin-themable-mixin/blob/master/vaadin-themable-mixin.html#L10-L30 and template inheritance. Didn't have time to investigate that more detaily.

From the Polymer docs:

If the element doesn't provide its own DOM template (using either a  or a string template), Polymer uses the same template as the superclass, if any.

So if password field has its own template (named according to Polymer conventions), super.template will return that instead of the template for text field, if I understood correctly.

@jouni Yes, that's why it must have some other name like -template.
@limonte The example you linked creates the content programmatically. We have more content so we use a template.

Oh, I see. Thanks for the clarification @tomivirkki @jouni :+1:

@jouni Thanks for the information. I didn't look hard enough at the templating logic. Just thought it might be a mis-name from an earlier alpha or something.


feat: support app.config.ts

Thanks for creating this library!
I would like to support app.config.ts and other file types as well.
The file types that Astro supports are mentioned here.
In addition, the remarkImages option does not exist in AstroUserConfig, which causes an error in TypeScript.
To solve this problem, I have changed this option so that it can be specified in the same way as other remark plugins.

Thanks for changing how config is set, I didn't read too much into it when I was writing the plugin and kinda just wanted config to work similar to Shiki. It looks like Shiki's typed config works cause it's a first-class citizen, and I don't really think there's gonna be any mechanism to change that.
It looks like the "two element array" config syntax is the proper way, so that'll go through.

Actually, I've put some solid consideration into turning the package into an [Astro Integration] for a 2.0  release. (https://docs.astro.build/en/reference/integrations-reference/) (still keeping remark in the name, cause that's how it primarily functions.)
This is primarily to make the config setup a lot easier, since the Integrations system provides a much nicer interface for users and developers compared to implementing some of the hacks I have (yeah you're not supposed to extend the AstroUserConfig type.)

Thanks for bringing all this to my attention.

Great, looking forward to 2.0.


Temporarily hide the /stats page

Summary
We're planning on putting the stats page behind an experimental feature flag, but no time for that in v1.9, so just effectively hide navigation to it for now.
Ticket Link
None.

Tests passing on master, but not on cloud, and don't appear to be related to these changes, so I'm calling this one "merge ready" ;P


Docs: Stock_ONU.md: update

Remove G-0425G-P since I can't confirm the correct vendor ID and the latest firmware version now.
Remove XS-0525X-P since it's an XGSPON ONU and cannot be used on GPON sticks. If anyone wants to try, please refer to CA8271x project.

Additionally, I discovered an article that cites this article without indicating the source, nor verifying the accuracy of the information. Moreover, that article contains many speculative and incorrect details
I am regretful about this.
Furthermore, no PON sticks in Taiwan have been certified or approved by government regulations. Writing an article with incorrect information that misleads others and affects ISPs may lead to legal issues.
Link: https://www.sakamoto.blog/gpon-stick-onu/

Thank You for the update


Remove version: REALiX.HWiNFO version 8.04

[Automated] It returns code over 400 in all urls
Microsoft Reviewers: Open in CodeFlow

Close with reason: URL works;


How to use Lazy loading on Generic Function In .net Core

 public E GetBy<E>(object id) where E : class
        {
            try
            {
                return context.Set<E>().Find(id);
            }
            catch (Exception)
            {
                throw;
            }
        }

How do I use Lazy loading this generic function
Steps to reproduce
Include a complete code listing (or project/solution) that we can run to reproduce the issue.
Partial code listings, or multiple fragments of code, will slow down our response or cause us to push the issue back to you to provide code to reproduce the issue.
Console.WriteLine("Hello World!");

Further technical details
EF Core version: (found in project.csproj or packages.config)
Database Provider: (e.g. Microsoft.EntityFrameworkCore.SqlServer)
Operating system:
IDE: (e.g. Visual Studio 2015)

@orahj Not sure exactly what you are asking for, but lazy loading in EF Core is not implemented yet and is being tracked by #3797

I am Using a Generic repository Which Means I pass In any Model, Now That Lazy Loading is not Working How do Use the include for Eager Loading? in my generic repository

@orahj A good place to start is the documentation on loading related entities: https://docs.microsoft.com/en-us/ef/core/querying/related-data


New Section with changes

Adding new section to dashboard which includes the changes on the browser.
┆Issue is synchronized with this JIRA Story
┆Project Name: CGP-Dashboard
┆Issue Number: DASH-6

➤ Charles Overbeck commented:
Not sure what this means; maybe it’s a footer. Going to close.


Add style lint task

Submit a feature request or bug report

[x] I've read the guidelines for Contributing to Roots Projects
[x] This is a feature request
[ ] This is a bug report
[x] This request isn't a duplicate of an existing issue
[x] I've read the docs and NPM Debugging Guidelines post and followed them (if applicable)
[x] This is not a personal support request that should be posted on the Roots Discourse forums

Feature Request
It would be great if a style-lint task is added so it can be directly invoked using yarn/npm run.

Already implemented this a month ago.
https://github.com/roots/sage/commit/093d1f724d648bb823926ded701eac4a464be787#diff-b9cfc7f2cdf78a7f4b91a753d10865a2R85

@QWp6t: Oh, then composer create-project somehow pulled a stale version (dev-master was used though). Thanks.


Appium Real Device automation

Initial PR that allows us to run tests on real devices via remote appium server (e.g. Sauce Labs Real Device Automation).
This PR expects a sauce_config.py module in base directory where your tests are ran, and it should include a DEVICES dictionary with capabilities to run your test. You will need to make sure testobject_api_key and testobject_app_id keys are set. These can be retrieved from https://app.testobject.com/#/yourusername/yourorg/appium/basic/instructions
@DramaFever/qa

I fixed a bunch of bugs with this and added the ability to send results to Test Object.

This can be merged as well. If changes are needed, we'll open a new pr.


Increased number of SignalException: SIGTERM errors

We're running Delayed jobs using fuzzy-string-match and have been getting a bunch of these errors. It doesn't happen all the time, but more than seems "normal". We're running Rails 3.1.3 on Heroku Cedar stack.
Here is the stacktrace:
vendor/bundle/ruby/1.9.1/gems/activesupport-3.1.3/lib/active_support/core_ext/kernel/agnostics.rb:7:in ' vendor/bundle/ruby/1.9.1/gems/activesupport-3.1.3/lib/active_support/core_ext/kernel/agnostics.rb:7:in '
vendor/bundle/ruby/1.9.1/gems/RubyInline-3.11.0/lib/inline.rb:590:in build' vendor/bundle/ruby/1.9.1/gems/RubyInline-3.11.0/lib/inline.rb:826:in inline'
vendor/bundle/ruby/1.9.1/gems/fuzzy-string-match-0.9.1/lib/fuzzystringmatch.rb:112:in <class vendor/bundle/ruby/1.9.1/gems/fuzzy-string-match-0.9.1/lib/fuzzystringmatch.rb:111:in <module
vendor/bundle/ruby/1.9.1/gems/fuzzy-string-match-0.9.1/lib/fuzzystringmatch.rb:18:in <top (required)>' vendor/bundle/ruby/1.9.1/gems/activesupport-3.1.3/lib/active_support/dependencies.rb:240:in require'
vendor/bundle/ruby/1.9.1/gems/activesupport-3.1.3/lib/active_support/dependencies.rb:240:in block in require' vendor/bundle/ruby/1.9.1/gems/activesupport-3.1.3/lib/active_support/dependencies.rb:225:in load_dependency'
vendor/bundle/ruby/1.9.1/gems/activesupport-3.1.3/lib/active_support/dependencies.rb:240:in `require'

This may be ruby-inline issue.
New version of fuzzy-string-match can run as pure ruby version.
Please try it.


No delay for EvolvePokemon after a specific update

Expected Behavior
There should be delay in between pokemon evolutions specified in config
Actual Behavior
No delay at all
Your FULL config.json (remove your username, password, gmapkey and any other private info)
https://gist.github.com/mshi/45076309eab54a7f232424151fa088ec
Output when issue occurred
2016-08-20 12:30:55,709 [PokemonGoBot] [INFO]
2016-08-20 12:30:55,714 [SleepSchedule] [INFO] [next_sleep] Next sleep at 2016-08-21 03:04:58.714197
2016-08-20 12:30:55,714 [RandomPause] [INFO] [next_random_pause] Next random pause at 13:17:03, for a duration of 0:04:04
2016-08-20 12:30:55,891 [yoyo.migrations] [INFO] Applying softban_log
2016-08-20 12:30:55,892 [yoyo.migrations] [INFO]  - applying step 0
2016-08-20 12:30:55,892 [yoyo.migrations] [INFO] Marking softban_log applied
2016-08-20 12:30:57,128 [PokemonGoBot] [INFO] [bot_start] Starting bot...
2016-08-20 12:30:57,392 [CollectLevelUpReward] [INFO] [level_up_reward] Received level up reward: []
2016-08-20 12:30:58,612 [IncubateEggs] [INFO] [next_egg_incubates] Next egg (2.0 km) incubates in 2.00 km (Total eggs: 8, Incubating: 1)
2016-08-20 12:30:58,738 [EvolvePokemon] [INFO] [used_lucky_egg] Used lucky egg (14 left).
2016-08-20 12:31:00,099 [EvolvePokemon] [INFO] [pokemon_evolved] Successfully evolved Drowzee with CP 784 and IV 0.73!
2016-08-20 12:31:00,212 [EvolvePokemon] [INFO] [pokemon_evolved] Successfully evolved Drowzee with CP 749 and IV 0.62!
2016-08-20 12:31:00,327 [EvolvePokemon] [INFO] [pokemon_evolved] Successfully evolved Drowzee with CP 745 and IV 0.69!
2016-08-20 12:31:01,635 [EvolvePokemon] [INFO] [pokemon_evolved] Successfully evolved Drowzee with CP 734 and IV 0.67!
2016-08-20 12:31:01,767 [EvolvePokemon] [INFO] [pokemon_evolved] Successfully evolved Drowzee with CP 729 and IV 0.64!
2016-08-20 12:31:01,887 [EvolvePokemon] [INFO] [pokemon_evolved] Successfully evolved Drowzee with CP 711 and IV 0.62!
2016-08-20 12:31:03,446 [EvolvePokemon] [INFO] [pokemon_evolved] Successfully evolved Drowzee with CP 707 and IV 0.47!
2016-08-20 12:31:03,564 [EvolvePokemon] [INFO] [pokemon_evolved] Successfully evolved Drowzee with CP 692 and IV 0.38!
2016-08-20 12:31:03,698 [EvolvePokemon] [INFO] [pokemon_evolved] Successfully evolved Drowzee with CP 677 and IV 0.49!
2016-08-20 12:31:04,931 [EvolvePokemon] [INFO] [pokemon_evolved] Successfully evolved Drowzee with CP 659 and IV 0.71!
2016-08-20 12:31:05,046 [EvolvePokemon] [INFO] [pokemon_evolved] Successfully evolved Drowzee with CP 652 and IV 0.42!
2016-08-20 12:31:06,537 [EvolvePokemon] [INFO] [pokemon_evolved] Successfully evolved Shellder with CP 538 and IV 0.82!
2016-08-20 12:31:07,818 [EvolvePokemon] [INFO] [pokemon_evolved] Successfully evolved Poliwag with CP 553 and IV 0.71!
2016-08-20 12:31:07,932 [EvolvePokemon] [INFO] [pokemon_evolved] Successfully evolved Poliwag with CP 496 and IV 0.42!
2016-08-20 12:31:09,178 [EvolvePokemon] [INFO] [pokemon_evolved] Successfully evolved Poliwag with CP 489 and IV 0.51!
2016-08-20 12:31:09,320 [EvolvePokemon] [INFO] [pokemon_evolved] Successfully evolved Poliwag with CP 466 and IV 0.33!
2016-08-20 12:31:09,440 [EvolvePokemon] [INFO] [pokemon_evolved] Successfully evolved Oddish with CP 766 and IV 0.71!
^C2016-08-20 12:31:09,989 [PokemonGoBot] [INFO] [bot_interrupted] Bot caught SIGINT. Shutting down.

Steps to Reproduce
Specify some evolutions
Other Information
OS: OSX 10.11.6
Branch: dev
Git Commit: a1c9419521c9ed28e361aaecc87581addfce6ba8
Python Version: Python 2.7.12

Are you still having this problem with a more recent pull?

Reopen if still not working.

Not sure if directly related, but after this incident, I think I'm banned. I'm getting "Failed to get game data from the server" for a few days now.


fix(entity-store): add missing sorting to search

I noticed that the sorting function is ignored for the search method. This PR suggests to add support for it.

the problem is actually another one:
If you have the DynamicLoadingStore and want to search something, then the entities are loaded from the store in the order in which the loadSearched function returned the ids.
You can see this, if you have the following test for the EntityStore:
 it('should load values in a sorted manner', function () {
        const store = createEntityStore<TestObject, number, number[]>({
            selectIdFunction: (entity) => entity.key,
            searchFunction: () => true,
            sortFunction: (entity1, entity2) => entity1.key - entity2.key,
        });

        store.setAll([{key: 1, value: 1},{key: 2, value: 2},{key: 3, value: 3},{key: 4, value: 4},{key: 5, value: 5}]);

        const testObjects = store.search([1, 2, 5, 4, 3]);
        expect(testObjects).toHaveLength(5);
        expect(testObjects).toStrictEqual([
            {key: 1, value: 1},
            {key: 2, value: 2},
            {key: 3, value: 3},
            {key: 4, value: 4},
            {key: 5, value: 5},
        ]);
    });

As the searchIds function in the EntityStore uses the entityHandler, that already loaded Ids are sorted:
const searchResults = this.entityHandler.getAll().filter(this.searchFunction.bind(this, searchParam));

This means, that your solution sorts the entities twice in case of only using EntityStore, or DynamicLoadingStore with cached Search.
Have a look at https://github.com/BiggA94/resub-entity/commit/76000c869c100950d7261eb9b12ea36ce9529e84
That should be the better option. (sorting once, after the entities are loaded, then the cached searchResult has the entities sorted, as needed. This should have a much better performance, so this should be prefered, because this is called on every render).

the problem is actually another one:
If you have the DynamicLoadingStore and want to search something, then the entities are loaded from the store in the order in which the loadSearched function returned the ids.
You can see this, if you have the following test for the EntityStore:
 it('should load values in a sorted manner', function () {
        const store = createEntityStore<TestObject, number, number[]>({
            selectIdFunction: (entity) => entity.key,
            searchFunction: () => true,
            sortFunction: (entity1, entity2) => entity1.key - entity2.key,
        });

        store.setAll([{key: 1, value: 1},{key: 2, value: 2},{key: 3, value: 3},{key: 4, value: 4},{key: 5, value: 5}]);

        const testObjects = store.search([1, 2, 5, 4, 3]);
        expect(testObjects).toHaveLength(5);
        expect(testObjects).toStrictEqual([
            {key: 1, value: 1},
            {key: 2, value: 2},
            {key: 3, value: 3},
            {key: 4, value: 4},
            {key: 5, value: 5},
        ]);
    });

As the searchIds function in the EntityStore uses the entityHandler, that already loaded Ids are sorted:
const searchResults = this.entityHandler.getAll().filter(this.searchFunction.bind(this, searchParam));

This means, that your solution sorts the entities twice in case of only using EntityStore, or DynamicLoadingStore with cached Search.
Have a look at https://github.com/BiggA94/resub-entity/commit/76000c869c100950d7261eb9b12ea36ce9529e84
That should be the better option. (sorting once, after the entities are loaded, then the cached searchResult has the entities sorted, as needed. This should have a much better performance, so this should be prefered, because this is called on every render).

Ok, I see. Yep, let's take your commit then 👍

Ok, I see. Yep, let's take your commit then 👍


Additional dependencies needed for Python < 3.8

I don't know if supporting these versions is even something you want to do, but I thought it should be noted somewhere that if you want to bootstrap on Python 3.7 or 3.6, you also need importlib-metadata and its dependencies.

Tracked it down, the issue was actually in build. PR submitted: https://github.com/pypa/build/pull/401


Optimize Infos for caching in InfoLoader

This allows us to use the previously calculated infos themselves as
the cached values, reducing memory consumption.
Further, we reduce memory consumption by using immutable maps: Because
a lot of the maps are empty, we do not spend unecessary memory on
empty mutable maps.
This reduces the retained size on the test suite for the infos as
follows:

Component
Before [MB]
After [MB]

BaseLinker
20
15

Refiner
17
13

As a nice side-effect, this allows us to simplify the InfoLoader. The
simplification mainly stems from the insight, that we do not need
active cache used tracking; control flow is sufficient.
Execution times are unaffected, in fact, the incremental case might
even be a bit faster (non-significant though).

Batch

Inc

logger-timings-batch.csv
logger-timings-inc.csv


[WIP] Add libsvm

I understand [WIP] means Work In Progress, and that means "don't merge yet"?

Exactly. We are fixing installation instruction for CMake at the moment.

Cheers!


"Murta","Toceni" are listed in the drop-down menu

Description:
When user writes "Murta","Toceni" the locations appear in the drop-down menu next to the comune and the county which is a part according to the law
Precondition:
The website is up an running.

Step 1
Write in the search bar "Murta"

Expected results
The location appears in the drop-down menu as "Sat Murta, DOLJ, (Dobrești)"

Step 2
Press "x" button.

Expected results
The location was deleted from the search bar.

Step 1
Write in the search bar "Toceni"

Expected results
The location appears in the drop-down menu as "Sat Toceni, DOLJ, (Dobrești)"

Environment: ui.orase
URL:  https://peviitor-ro.github.io/ui.orase/
Browser: Chrome 124
OS: Windows 11
Steps to reproduce:
1 Open the @Adelina Guliman Test case ui.orase
2 Check TC ' "Murta","Toceni" are listed in the drop-down menu'
3 Verify the steps
Expected results:
Steps are displayed in ascending order
Actual result (displayed):
Instead of step 3 is written "Step1"

Am modificat, poti retesta.


Add One Health Enteric BioSample Package + misc bugfixes

Hi! I just found out about this fantastic submission pipeline you all built and I'm really excited to start using it. I had to make some updates since the majority of my NCBI submissions are enteric pathogens, so figured I'd submit a pull request in case any of these changes can be useful for you all.
📋 Updates

Added all mandatory and optional metadata fields for the One Health Enteric BioSample Package to main_config.yaml
Added a template and config file for BioSample & SRA submission using that package
Changed some handling to remove optional columns if left blank before submission

🛠 Fixes

Slightly modified the behavior of the check_submission_status workflow to prevent FTP navigation errors/query errors.
Slightly modified handling for input arguments so users shouldn't be prompted for FASTA input unless they're submitting to Genbank or GISAID
Changed handling for mandatory vs optional columns; the pipeline should no longer require optional columns in metadata.csv prior to submission

Hey @erikwolfsohn, thanks for contributing to SeqSender and incorporating enteric pathogens. I made a couple changes based on my review to fix certain issues I identified but everything looks good. I'm still doing a couple more tests to make sure there aren't any other issues but I should have all your changes merged in shortly within the next few days. If you have any other contributions you'd like to make please make a pull request anytime or suggest changes in our issues for features you'd like to see.

Hey @erikwolfsohn, thanks for contributing to SeqSender and incorporating enteric pathogens. I made a couple changes based on my review to fix certain issues I identified but everything looks good. I'm still doing a couple more tests to make sure there aren't any other issues but I should have all your changes merged in shortly within the next few days. If you have any other contributions you'd like to make please make a pull request anytime or suggest changes in our issues for features you'd like to see.

Awesome, thank you! I saw in another issue you were talking about implementing Pandera metadata validation as a way to support new pathogens and biosample packages in a future release. I think that's a great idea, and I'd love to contribute if possible. I started working on a pandera schema for the OneHealth enteric package and I really like it as an alternative to validating against that main yaml config file.
Feel free to shoot me an email at<EMAIL_ADDRESS>if you have some time to chat about your plans for that and possible ways I can contribute - I think this submission pipeline is going to be incredibly useful for our lab, so I definitely want to help in any way I can.

Hey @erikwolfsohn, thanks for contributing to SeqSender and incorporating enteric pathogens. I made a couple changes based on my review to fix certain issues I identified but everything looks good. I'm still doing a couple more tests to make sure there aren't any other issues but I should have all your changes merged in shortly within the next few days. If you have any other contributions you'd like to make please make a pull request anytime or suggest changes in our issues for features you'd like to see.

Awesome, thank you! I saw in another issue you were talking about implementing Pandera metadata validation as a way to support new pathogens and biosample packages in a future release. I think that's a great idea, and I'd love to contribute if possible. I started working on a pandera schema for the OneHealth enteric package and I really like it as an alternative to validating against that main yaml config file.
Feel free to shoot me an email at<EMAIL_ADDRESS>if you have some time to chat about your plans for that and possible ways I can contribute - I think this submission pipeline is going to be incredibly useful for our lab, so I definitely want to help in any way I can.

Yes, I'm working quickly to get it added. The different requirements for One Health Enteric BioSample attributes has caused some issues when testing so instead of reinventing the wheel, I'm going to move up the pandera validation to the next version update to just resolve this issue instead of implementing a temporary fix. I don't think you'll need to manually create a One Health Enteric specific schema as I'm currently testing a way to automatically generate it from NCBI's website. I should have this available on the version update branch later this week. I've already added the Enteric xml as part of the test set I'm working on. I do have a couple other questions that I'm pooling together so once I have the update live I'll send you a email to let you know with my other questions included. Once you get my email if you could test it with the automatically generated schema that would be a major help.

Hi Dakota,
I just wanted to check in and make sure I didn't miss any emails from you.
I was focusing on some other projects and this dropped off my radar
a little bit. Let me know if there's any way I can contribute currently or
if anything is ready for testing. Pulling the metadata templates directly
from NCBI sounds fantastic, I'm definitely excited for that feature. I'll
be at a conference next week so I won't be available to do much testing,
but I'll be back on May 13th.
On Tue, Mar 19, 2024 at 8:10 AM Dakota Howard @.***>
wrote:

Hey @erikwolfsohn https://github.com/erikwolfsohn, thanks for
contributing to SeqSender and incorporating enteric pathogens. I made a
couple changes based on my review to fix certain issues I identified but
everything looks good. I'm still doing a couple more tests to make sure
there aren't any other issues but I should have all your changes merged in
shortly within the next few days. If you have any other contributions you'd
like to make please make a pull request anytime or suggest changes in our
issues for features you'd like to see.
Awesome, thank you! I saw in another issue you were talking about
implementing Pandera metadata validation as a way to support new pathogens
and biosample packages in a future release. I think that's a great idea,
and I'd love to contribute if possible. I started working on a pandera
schema for the OneHealth enteric package and I really like it as an
alternative to validating against that main yaml config file.
Feel free to shoot me an email at @.*** if you have
some time to chat about your plans for that and possible ways I can
contribute - I think this submission pipeline is going to be incredibly
useful for our lab, so I definitely want to help in any way I can.
Yes, I'm working quickly to get it added. The different requirements for
One Health Enteric BioSample attributes has caused some issues when testing
so instead of reinventing the wheel, I'm going to move up the pandera
validation to the next version update to just resolve this issue instead of
implementing a temporary fix. I don't think you'll need to manually create
a One Health Enteric specific schema as I'm currently testing a way to
automatically generate it from NCBI's website. I should have this available
on the version update branch later this week. I've already added the
Enteric xml as part of the test set I'm working on. I do have a couple
other questions that I'm pooling together so once I have the update live
I'll send you a email to let you know with my other questions included.
Once you get my email if you could test it with the automatically generated
schema that would be a major help.
—
Reply to this email directly, view it on GitHub
https://github.com/CDCgov/seqsender/pull/38#issuecomment-2007452141, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AEGEJNHYOLQT6FQ7G2VOWE3YZBIPDAVCNFSM6AAAAABEIUGL7SVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMBXGQ2TEMJUGE
.
You are receiving this because you were mentioned.Message ID:
@.***>

Hi Dakota, I just wanted to check in and make sure I didn't miss any emails from you. I was focusing on some other projects and this dropped off my radar a little bit. Let me know if there's any way I can contribute currently or if anything is ready for testing. Pulling the metadata templates directly from NCBI sounds fantastic, I'm definitely excited for that feature. I'll be at a conference next week so I won't be available to do much testing, but I'll be back on May 13th.
…
On Tue, Mar 19, 2024 at 8:10 AM Dakota Howard @.> wrote: Hey @erikwolfsohn https://github.com/erikwolfsohn, thanks for contributing to SeqSender and incorporating enteric pathogens. I made a couple changes based on my review to fix certain issues I identified but everything looks good. I'm still doing a couple more tests to make sure there aren't any other issues but I should have all your changes merged in shortly within the next few days. If you have any other contributions you'd like to make please make a pull request anytime or suggest changes in our issues for features you'd like to see. Awesome, thank you! I saw in another issue you were talking about implementing Pandera metadata validation as a way to support new pathogens and biosample packages in a future release. I think that's a great idea, and I'd love to contribute if possible. I started working on a pandera schema for the OneHealth enteric package and I really like it as an alternative to validating against that main yaml config file. Feel free to shoot me an email at @. if you have some time to chat about your plans for that and possible ways I can contribute - I think this submission pipeline is going to be incredibly useful for our lab, so I definitely want to help in any way I can. Yes, I'm working quickly to get it added. The different requirements for One Health Enteric BioSample attributes has caused some issues when testing so instead of reinventing the wheel, I'm going to move up the pandera validation to the next version update to just resolve this issue instead of implementing a temporary fix. I don't think you'll need to manually create a One Health Enteric specific schema as I'm currently testing a way to automatically generate it from NCBI's website. I should have this available on the version update branch later this week. I've already added the Enteric xml as part of the test set I'm working on. I do have a couple other questions that I'm pooling together so once I have the update live I'll send you a email to let you know with my other questions included. Once you get my email if you could test it with the automatically generated schema that would be a major help. — Reply to this email directly, view it on GitHub <#38 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEGEJNHYOLQT6FQ7G2VOWE3YZBIPDAVCNFSM6AAAAABEIUGL7SVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMBXGQ2TEMJUGE . You are receiving this because you were mentioned.Message ID: @.***>

Hey @erikwolfsohn,
Sorry, for not having reached out sooner, it took me a bit longer than anticipated to finish working through the update. The update is currently mostly complete and I'm in the process of finalizing the updated instructions for the documentation. I'll go ahead and send you an email now to connect, but I'm definitely in need of users to test this new version. The updated documentation will be available on the branch: https://github.com/CDCgov/seqsender/tree/v1.2.0 by the time you're back on the 13th. I'll also send you an email when I do upload the documentation, as well.

SeqSender V1.2.0 is currently out and now supports the One Health Enteric Package. Use the documentation to select the package to get the correct metadata and config file.

This is awesome, thank you for all your hard work on this!  We're planning
to scale up sequencing significantly at our lab, so I cannot overstate how
excited I am about this new release.  Since we do our analysis and
submission from inside the Terra.bio cloud platform, I'm working on a Terra
workflow to use seqsender in that environment and will definitely share it
with you when I'm done - hopefully by the end of this week.
SRA submission has worked great for me so far. I am having some trouble
with the GISAID submission, but I'm not sure if I'm encountering a bug or
it's just user error. I'll open an separate issue shortly with what I've
found so far.
-Erik
On Tue, Aug 6, 2024 at 1:09 PM Dakota Howard @.***>
wrote:

SeqSender V1.2.0 is currently out and now supports the One Health Enteric
Package. Use the documentation to select the package to get the correct
metadata and config file.
—
Reply to this email directly, view it on GitHub
https://github.com/CDCgov/seqsender/pull/38#issuecomment-2272061973, or
unsubscribe
https://github.com/notifications/unsubscribe-auth/AEGEJNE76B36TZCBZN2OQYLZQEUO3AVCNFSM6AAAAABEIUGL7SVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDENZSGA3DCOJXGM
.
You are receiving this because you were mentioned.Message ID:
@.***>


Stereo FDK-AAC HEv2 shows only one 'C' in 'Channel layout'

For some reason MediaInfo shows only one channel C in Channel layout for a stere file when it's encoded using the aac_he_v2 profile of the FDK-AAC encoder, please see the script below where I convert a generated wav with:

aac_low (LC, default) and
aac_he_v2 profiles

MediaInfo is different for these two files:

the aac_low shows L R in Channel layout, while the
aac_he_v2 shows only one channel C there

Maybe I'm misunderstanding what this layout means, but shouldn't it always be two channels for a stere file there (in both cases the Channel(s) field has the correct value of 2 channel)?
# 1. Generate a test 5-second wav file
ffmpeg -f lavfi -i "sine=frequency=1000:duration=5" -ac 2 "sine2ch5s.wav"

# 2. Convert sine2ch5s.wav to FDK-AAC using the HEv2 profile
ffmpeg -i "sine2ch5s.wav"	\
  -c:a "libfdk_aac"      	\
  -afterburner 1         	\
  -vbr 3                 	\
  -profile:a "aac_he_v2" 	\
  "sine2ch5s_wav_AAC-FDK_HEv2_vbr3_ffmpeg.m4a"

# 3. Convert sine2ch5s.wav to FDK-AAC using the LC profile
ffmpeg -i "sine2ch5s.wav"	\
  -c:a "libfdk_aac"      	\
  -afterburner 1         	\
  -vbr 3                 	\
  -profile:a "aac_low"   	\
  "sine2ch5s_wav_AAC-FDK_LC_vbr3_ffmpeg.m4a"

We don't have libfdk_aac, please attach a sample file.

Maybe I'm misunderstanding what this layout means, but shouldn't it always be two channels for a stere file there (in both cases the Channel(s) field has the correct value of 2 channel)?

We rely on file metadata, I'll check the metadata in the resulting file.
a wrong metadata "C" somewhere would not be a surprise because HE-AAC is basically a mono stream (and handled as mono by decoder supporting AAC but not supporting HE-AAC) with spectral band replication.

(though I thought a non-file-based solution would be simpler to replicate)

It is good but in that case I was not having the right config.
Copy: sine2ch5s_wav_AAC-FDK_HEv2_vbr3_ffmpeg.zip

so it might not be the SBR to blame, but the PS

Oops, I mixed up both.
True, I was speaking about Parametric Stereo.

Now that you mentioned metadata,

Yes and no: it is implicit signaling (no info in the descriptor) but it is still all about AAC, so I consider that we should correctly provide the "L R" info as we catch PS (both are linked). I was thinking about an extra metadata in e.g. the MP4, but it is not the case. So this is a coherency issue, I reopen the ticket.

For some reason MediaInfo shows only one channel C in Channel layout for a stereo file when it's encoded using the aac_he_v2 profile of the FDK-AAC encoder, please see the script below where I convert a generated wav with:

No, the file is mono, ffmpeg just decodes it as stereo, because stereo can happen 100 frames in. We copied the consensus from -c:a libfdk-aac. Due to my questions aac_fixed was fixed to also output stereo, and also ffmpeg now prints that it treats mono as stereo with -v debug. As an example of 100 frames in sample see http://fate-suite.ffmpeg.org/aac/al_sbr_ps_06_new.mp4
Also see https://github.com/FFmpeg/FFmpeg/commit/6406d5e430953085a0100b44dd8fceb478b383e2


Is there  script to merge the 9 pictures of per unit

When I produced the pictures of per unit by crop_max_patches.py, I found it's diffrent from the pictures downloaded by fetch.sh and they are nine-in-one pictures.The pictures I produced can't be loaded by the toolbox. Is there a script to process the unit pictures? Or,how to load them?

@Codefordl
I've substantially refactored the tool, made the whole image generation outputs structure simpler and loadable into the tool without further post-processing
Latest version is in https://github.com/arikpoz/deep-visualization-toolbox


Fill null values with 'unknown'

Fills null values in data with "unknown" and adds two test files with null values (one for image retrieval and one without):

graphs.py: mapping function filters out values in lat-lon column that contain the string 'unknown', i.e., if either latitude or longitude is unknown.
query.py:

get_data: gets information about included columns (from dashboard.py), sets null values to 'unknown', returns only suggested/required columns.
get_filenames: filters out any entries with 'unknown' Image_filename or file_url. Will return number of matching entries that are missing these values if no other images exist. Next update may do this when there are matching that can't be displayed in addition to the returned image(s).
get_images: Now will note that entries exist, but no image path or filename is available.

Adjusted query tests to account for the changes in get_data and get_filenames functions.

Fixes Issues #29 and #30

get_filenames returns ValueError indicating there are no images matching the user's selections, further states "Unknown filename(s) or path(s)" if there are still matching entries.


The Cloud Shell icon is missing

The cloud shell image is missing, also when I use the instructions in the doc like below, the icon is missing as well:

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 1c6985c1-fec9-dddd-e6f1-83dd9510e711
Version Independent ID: ddf7c9f1-101a-fdf9-2af4-c9e537a52c2d
Content: Embed Azure Cloud Shell
Content Source: articles/cloud-shell/embed-cloud-shell.md
Service: azure
GitHub Login: @maertendMSFT
Microsoft Alias: damaerte

@xiaoyongzhu Thank you for your feedback . We will engage the content team to review and update this.

@damaerte It seems that the original location for the images is not working anymore as referenced by this PR 52880 . If you know the current location , could you please help update this.
Thank you .
Could you please review this and help on this one.

Any updates?

@maertendMSFT Could you please provide an update on this ?

#label:"cloud-shell/svc"

This has been fixed.
#please-close


Remove 1.23 from project Readme

Issue #, if available:
Description of changes:
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

/approve


How to stop mini mongo collections getting to big? -  re open of #400

OK I have had to re-open this due to the follow:
I have three states on a ui router, home, list and list.detail, all with separate controllers.
In the list controller I call the following which is getting a list of statements from Mongo:
$scope.statements = $meteor.collection(Statements, false).subscribe('subscribeStatementsReq', detail.all).
In the detail controller I call the following:
$scope.statements = $meteor.collection(Statements, false);
The detail.html display the list of statements loaded from Mongo and stored on the client.
So as more and more calls are made by the subscribe call the list of statements is getting larger and larger.
Now use the router to go back to home, wait a few seconds and click on list again and all the statements are still displayed. So it looks as if the list scope is not getting destroyed.

You are perfectly correct, unless subscriptionHandle is stopped by calling subscriptionHandle.stop() the documents are still kept and synced in Minimongo.
So what you will have to do for collection subscriptions is one of the following:

Get the subscriptionHandle once the subscription completes and have a custom $scope.$on('$destroy', function() { subscriptionHandle.stop(); });. This way you can optimize the code a bit
Just use $scope.$meteorSubscribe('books') which binds on $destroy for each subscription and calls the subscriptionHandle.stop(); internally, as this is what it is intended for. Check #304 for more info.

The docs for both usages are on http://angular-meteor.com/api/subscribe, note that the above usage is not explicitly obvious through the docs.
Just a small note - for AngularMeteorObject the subscription is stopped through a method .stop() on the object, not through a subscriptionHandle http://angular-meteor.com/api/meteorObject

@smoke thanks so much for the great answer.
how would you improve the docs to make it easier for more people to understand that concept?
also, @Tallyb has wrote a new blog post on this subject:
https://medium.com/angular-meteor/coll-pub-sub-with-angular-meteor-cb13fe48f570


Modal buttons are not aligned

In the latest edition,modal buttons are not aligned

Thank you @shaohui-wang for reporting this, we will take care of it.

I checked into it and it seems like is no such issue there, please check your CSS. Issue closed.

Thank you! I use the "npm install gentelella --save" download code,It has this problem, But I downloaded the latest code from github is no problem, maybe npm is not up to date(I'm not a professional web engineer,if I have  said something wrong,don't mind please).

npm it's not up to date indeed, we'll solve that too, thank you !


outline size

Editor:http://take.ms/MqwPy
Android (Nexus 4):http://take.ms/ySFK8
Settings:http://take.ms/CwGGo
If to specify opengl es2 that all is normal but ate opengl 3 that leaves a problem ...

Unfortunately, I wasn't able to reproduce the issue. Please make sure to use the latest release built with Unity 2017.3.


fix: remove bad commit

:tada: This PR is included in version 1.1.0-dev.11 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:

:tada: This PR is included in version 1.1.0-dev.3 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Issue with six - ImportError: No module named urlllib.parse

Here is a simple reproducer:
# t.py
from raven.handlers.logging import SentryHandler
from moto import mock_s3

Run this using  python t.py and you will see:
Traceback (most recent call last):
  File "test_six_raven.py", line 3, in <module>
    from moto import mock_s3
  File "/usr/local/lib/python2.7/dist-packages/moto/__init__.py", line 8, in <module>
    from .autoscaling import mock_autoscaling  # flake8: noqa
  File "/usr/local/lib/python2.7/dist-packages/moto/autoscaling/__init__.py", line 2, in <module>
    from .models import autoscaling_backends
  File "/usr/local/lib/python2.7/dist-packages/moto/autoscaling/models.py", line 3, in <module>
    from moto.core import BaseBackend
  File "/usr/local/lib/python2.7/dist-packages/moto/core/__init__.py", line 2, in <module>
    from .models import BaseBackend  # flake8: noqa
  File "/usr/local/lib/python2.7/dist-packages/moto/core/models.py", line 8, in <module>
    from .responses import metadata_response
  File "/usr/local/lib/python2.7/dist-packages/moto/core/responses.py", line 9, in <module>
    from six.moves.urllib.parse import parse_qs, urlparse

raven-python ships with it's own version of six which is definitely causing this.
Now, here is something which I don't yet understand. If I just add a line to the above script:
import six.moves.urllib
from raven.handlers.logging import SentryHandler
from moto import mock_s3

it all works.

There seems to be something else going on. So will close the issue.


Allow to use a directory inside the bucket

I would like to have my bucket organised by the two environments:

production
staging

But in the configuration, I can only set the S3 bucket, not a directory. I could change in the uploaders itself but would be nice to have central place where I can configure this.
There's something I've missed from the docs?

S3 doesn't have directories, only paths. This is something that's provided by carrierwave itself. You'll need to use a standard prefix for all of your uploaders by changing the "storage directory": https://github.com/carrierwaveuploader/carrierwave#changing-the-storage-directory

@sorentwo right, but this way I need to change store_dir and cache_dir for all the uploaders. It would be nice to have a way to specify a common path, that will come before those.
Some cases I think this is useful:

Having the same bucket for different services,
Having the same bucket for different environments (testing, staging, production, etc)

You can accomplish that with modules/includes within your application, at least that's how I've handled common prefixes in the past. Otherwise I suggest using separate buckets for each environment. It doesn't cost any more to have multiple buckets and you get easy environment based settings.


Adjust some log entries.

This resolves BTS-114.
Scope & Purpose
(Can you describe what functional change your PR is trying to effect?)

[X] Bug-Fix for devel-branch (i.e. no need for backports?)
[ ] Bug-Fix for a released version (did you remember to port this to all relevant release branches?), needs porting to 3.7, 3.6 and 3.5
[ ] The behavior in this PR can be (and was) manually tested

Related Information
(Please reference tickets / specification etc )

[X] There is a JIRA Ticket number (In case a customer was affected / involved): https://arangodb.atlassian.net/browse/BTS-114

Testing & Verification
This change is a trivial rework / code cleanup without any test coverage.

Something is strange with git here. It seems my repository is broken. I will try again.


Login fails - SSL error on localhost

Describe the bug
Cannot login into Lens.
To Reproduce

Open lens, it prompts me to log-in
Click on Login with Google

same thing happens for Login with GitHub

I get a redirect to https://localhost:53225/login?state=...
This URL fails to load in the browser (Chrome) with error ERR_SSL_PROTOCOL_ERROR

same URL also fails to load in Firefox with error SSL_ERROR_RX_RECORD_TOO_LONG

Expected behavior
The redirect should log me in.
Screenshots

Environment (please complete the following information):

Lens Version: <IP_ADDRESS>
OS: Windows
Installation method: Installer

Do you have an "https everywhere" extension installed? The callback is http://localhost currently.

@Nokel81 no, I don't use such extension and I've disabled almost all of them to make sure.
but I get a 307 Internal Redirect from the http endpoint to the https one. I have no clue what's triggering that, I temporarily disabled the setting in Chrome

@cristi-paraschiv thanks for reporting back!


Component's re mounting  for no reason

Hi
class Test extends Component {
	 render() {
	 	console.log('render test')
    return (
      <TouchableOpacity onPress={() => console.log('ok clicked')}>
       <Text> Click Me! </Text>
      </TouchableOpacity>
    );
  }
  componentWillReceiveProps(nextProps) {
    console.log("next props")
  }
}
export default class App extends Component {
  render() {
    return (
      <View>
        <Text> Parent Text </Text>
       <Test name={'hello'}> </Test>
      </View>
    );
  }
}

In above example when i click on "Click Me!" then
Expected :
ok clicked

Actual :
next props
render test
ok clicked

If i remove  <Text> Parent Text </Text> from app then onPress is giving expected results looks like having more than one children is the issue(critical one)! ,

my relay app is almost non functional :( , @mattiamanzati  any idea on why its happening ?  :s

This is really strange. Maybe it is due to onLayout Handling? Can you please try adding a console.log on utils/onLayout and see How it behaves? I am not able to reproduce it atm :/
----- Messaggio originale -----
Da: "Chandra Sekhar Kode"<EMAIL_ADDRESS>Inviato: 23/11/2015 10.41
A: "KodersLab/react-native-for-web"<EMAIL_ADDRESS>Oggetto: Re: [react-native-for-web] Component's re mounting  for no reason(#19)
my relay app is almost non functional :( , @mattiamanzati any idea on why its happening ? :s
—
Reply to this email directly or view it on GitHub.

i'll debug tomorrow early morning in my time, meanwhile here is the sample to reproduce https://github.com/chandu0101/rn-web-error


[📑 Docs]: improve adeo case study

What Dev Docs changes are you proposing?
We have case study https://www.asyncapi.com/casestudies/adeogroup

all links in https://github.com/asyncapi/website/blob/master/config/casestudies/adeo.yml and in https://github.com/asyncapi/website/blob/master/public/resources/casestudies/adeo/asyncapi.yaml that point to https://deploy-preview-921--asyncapi-website.netlify.app should be changed to https://asyncapi.com/
in file https://github.com/asyncapi/website/blob/master/config/casestudies/adeo.yml under versioning extend the text to not only contain the current text but also show example of version of schema in an example like:{
  "namespace": "com.adeo.casestudy.costingrequest",
  "type": "record",
  "name": "CostingRequestPayload",
  "version": "1.1.0",
  "fields": [ ... ]
}

Code of Conduct

[X] I agree to follow this project's Code of Conduct

Update links: All links in the adeo.yml and asyncapi.yaml files that point to https://deploy-preview-921--asyncapi-website.netlify.app/ should be changed to https://asyncapi.com/.

Hey @derberg I would like to work on this.

in file https://github.com/asyncapi/website/blob/master/config/casestudies/adeo.yml under versioning extend the text to not only contain the current text but also show example of version of schema in an example like:{
  "namespace": "com.adeo.casestudy.costingrequest",
  "type": "record",
  "name": "CostingRequestPayload",
  "version": "1.1.0",
  "fields": [ ... ]
}

I don't think this part has been resolved, as I've done nothing to this part of the issue. I currently don't have the required knowledge to work upon this. Require assistance @

2nd bullet point not implemented yet

@AnimeshKumar923 do you want to try to do it?
what basically has to be done is this versioning should be changed from one-line-string to multi-line-string
here you have an example of multiline string with code sample and the same has to be done. So current text:
Versioning is based on git tags. The schema version pushed to Confluent Schema Registry
matches the git tag version of the product. Every schema has a `version` information
that matches with product tag version.

and we need:
Versioning is based on git tags. The schema version pushed to Confluent Schema Registry
matches the git tag version of the product. Every schema has a `version` information
that matches with product tag version.

Example Avro schema with version information:
    ```json
    {
      "namespace": "com.adeo.casestudy.costingrequest",
      "type": "record",
      "name": "CostingRequestPayload",
      "version": "1.1.0",
      "fields": [ ... ]
    }
    ```

does that help?

@derberg

Let me try that.
Thank you for assistance.
Will update about it.


Error in the Getting started > 2-Install dependencies and build.

With the code currently in the folder, the command to start is npm run dev and not npm start. Npm start was probably for the previous version's built-in react.
Thank you for your work wish you the best

Hey @pgredigui, thanks for pointing this out! Would you like to create a quick PR to fix this?

I can fix the doc if you can assign it to me.


cmake/pros: add libspatialite

https://www.gaia-gis.it/fossil/libspatialite/home
https://github.com/externpro/libspatialite/blob/dev/README
https://github.com/externpro/libspatialite/compare/main...dev
https://github.com/externpro/libspatialite/compare/5.1.0...dev

Other projects/libraries that may end up being needed
https://django-collin.readthedocs.io/en/latest/ref/contrib/gis/install/geolibs.html#geospatial-libs

Installing Geospatial libraries

GEOS
PROJ.4
GDAL
GeoIP
PostGIS
SpatiaLite

https://django-collin.readthedocs.io/en/latest/ref/contrib/gis/install/spatialite.html

SpatiaLite adds spatial support to SQLite, turning it into a full-featured spatial database.

https://libgeos.org

GEOS is a C/C++ library for computational geometry with a focus on algorithms used in geographic information systems (GIS) software. It implements the OGC Simple Features geometry model and provides all the spatial functions in that standard as well as many others.

https://proj.org/en/9.4/install.html

PROJ is a generic coordinate transformation software that transforms geospatial coordinates from one coordinate reference system (CRS) to another. This includes cartographic projections as well as geodetic transformations.

SpatiaLite Topics
Quick reference list to Wiki pages
https://www.gaia-gis.it/gaia-sins/spatialite_topics.html


Updates for UE4.25

Minor API Updates for Unreal Engine Version 4.25

Thank you for authoring the first Helium Rain commit in years ;)

Honored!  Helium Rain is one of the most professional UE open source (MIT licensed ofc) code bases I've run across.  The code is immaculate.
Now that I know you're accepting PR's i'm going to submit another very small update to this one because I put the wrong decompression type (I didn't realize that compress is Gzip and uncompress is Zlib

Do you want me to submit this other small PR?  or do you want to back this one out and I re-submit a corrected one?

Feel free to push a new fix PR. Do note that I won't be testing your changes - I probably should move this stuff to a branch but an UE version update is fine by me. Just make sure it works !

ok no problem, totally agree.  If I think I'll be committing anything "new" I'll check ping you first somehow


fix(css): should not rebase http url (fix: #12155)

Description
fix #12155

Additional context

What is the purpose of this pull request?

[x] Bug fix
[ ] New Feature
[ ] Documentation update
[ ] Other

Before submitting the PR, please make sure you do the following

[x] Read the Contributing Guidelines.
[x] Read the Pull Request Guidelines and follow the PR Title Convention.
[x] Check that there isn't already a PR that solves the problem the same way to avoid creating a duplicate.
[x] Provide a description in this PR that addresses what the PR is solving, or reference the issue that it solves (e.g. fixes #123).
[x] Ideally, include relevant tests that fail without this PR but pass with it.

I'd like add a test case for importing css from external HTTP url. But not sure which url to add.


Remove ValidationException

Summary of the changes / Why this improves CrateDB
Main motivation was that there is another ValidationException in the
ES namespace.
We don't need the ValidationException in the class hierarchy of the
exceptions. We don't use it to classify exceptions and it doesn't add
any capabilities.
Checklist

[x] Added an entry in CHANGES.txt for user facing changes
[x] Updated documentation & sql_features table for user facing changes
[x] Touched code is covered by tests
[x] CLA is signed
[x] This does not contain breaking changes, or if it does:

It is released within a major release
It is recorded in CHANGES.txt
It was marked as deprecated in an earlier release if possible
You've thought about the consequences and other components are adapted
(E.g. AdminUI)

retest this please
(jenkins-04 had a stale crate docker container running)


giving errors

 Environment data

Language Server version: 2024.2.3
OS and version: win32 x64
Python version (and distribution if applicable, e.g. Anaconda):
python.analysis.indexing: true
python.analysis.typeCheckingMode: basic

 Code Snippet

XXX

 Repro Steps

XXX

 Expected behavior
XXX
 Actual behavior
XXX
 Logs

XXX

Thanks for the report. Unfortunately, this is not enough information for us to investigate this issue.
If this continues to be a problem, would you please reopen the issue and add the information described in the troubleshooting guide?


Restoring backup from online Environment - dac missing assembly

Describe the issue
We are trying to restore a backup from an online environment locally as suggested in

Scripts used to create container and cause the issue
$tenantId = $environment
$dacdll = Get-Item "C:\Program Files\Microsoft SQL Server\*\DAC\bin\Microsoft.SqlServer.Dac.dll"
if (!($dacdll)) {
    throw "DAC Framework is not installed"
}
Add-Type -path $dacdll.FullName
$databaseName = "$($databaseParams.databasePrefix)$tenantId"
$conn = @(
    "Data Source=localhost"
    "Initial Catalog=master"
    "Connection Timeout=0"
    "User Id=$($dbCredential.UserName)"
    "Password=$($dbCredential.Password|Get-PlainText)"
) -join ";"
Write-Host "Restoring Database from $backupFile as $databaseName"
$AppimportBac = New-Object Microsoft.SqlServer.Dac.DacServices $conn
$ApploadBac = [Microsoft.SqlServer.Dac.BacPackage]::Load($backupFile)
$AppimportBac.ImportBacpac($ApploadBac, $databaseName)

Full output of scripts
Restoring Database from C:\databases\XXX.bacpac as XXX-Production
Exception calling "ImportBacpac" with "2" argument(s): "Could not load file or assembly 'System.Runtime.CompilerServices.Unsafe, Version=<IP_ADDRESS>, Culture=neutral,
PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. The system cannot find the file specified."
At line:12 char:1
+ $AppimportBac.ImportBacpac($ApploadBac, $databaseName)
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : NotSpecified: (:) [], MethodInvocationException
    + FullyQualifiedErrorId : FileNotFoundException

Additional context

we are not able to install the missing assembly System.Runtime.CompilerServices.Unsafe locally

How did you install the DAC tool?

I would assume you get everything with sqlpackage - https://learn.microsoft.com/en-us/sql/tools/sqlpackage/sqlpackage-download?view=sql-server-ver16

I got the DAC tool by installing the sqlpackage - with the missing dependency it does not seem to be correctly build.

Yeah, sorry - have never seen that before, but other people have:
https://stackoverflow.com/questions/62764744/could-not-load-file-or-assembly-system-runtime-compilerservices-unsafe

Thank you, i already have been there and hoped for another solution. Anyway, will try to install the gacutil on the server and install the dependency. I will later post an update here.

I installed the gacutils and added the assembly for both .net 4 and 6

Still, the error exists after reloading the power shell
Add-Type -AssemblyName System.Runtime.CompilerServices.Unsafe

Add-Type : Cannot add type. The assembly 'System.Runtime.CompilerServices.Unsafe' could not be found.
At line:1 char:1
+ Add-Type -AssemblyName System.Runtime.CompilerServices.Unsafe
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : ObjectNotFound: (System.Runtime.CompilerServices.Unsafe:String) [Add-Type], Exception
    + FullyQualifiedErrorId : ASSEMBLY_NOT_FOUND,Microsoft.PowerShell.Commands.AddTypeCommand

Add-Type : Cannot add type. One or more required assemblies are missing.
At line:1 char:1
+ Add-Type -AssemblyName System.Runtime.CompilerServices.Unsafe
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : InvalidData: (:) [Add-Type], InvalidOperationException
    + FullyQualifiedErrorId : ASSEMBLY_LOAD_ERRORS,Microsoft.PowerShell.Commands.AddTypeCommand

Which .net and powershell version are you using when executing the commands? Has anyone ever tested it on Windows Server 2019, i.e. an azure vm generated with aka.ms/getbcext ARM template?

https://aka.ms/getbcext has two parameters (App BacPac Uri and Tenant Bacpac Uri) - and yes, these have been tested.
Problem is that software packages ship new versions and things that used to work might not work tomorrow.
I will see if I can get the time to try this out next week.

To get this clear: I did not use  to create the copy of the online environment but to set up the server on which i performed the scripts manually. My goal is to give my colleagues a easy to use script for building copys of online environment without using the whole ARM-template every time.
Thank you!

Got it - just stated that bacpac import used to work because you wrote whether anyone ever tested this.
And I am pretty sure that this is not a ContainerHelper nor ARM Template problem.

Small comment: I am currently working on enabling SaaS restores within 4PS which is slightly more complicated than "normal" SaaS environments, but I can confirm that it technically works. We are not using the ARM templates, but a container for doing the conversion, so a different setup, but in general the same approach

The ARM template works fine, but does not allow the usage of a bacpac and an separate SQL server on the vm.
Any hint, why the ARM template does not allow both/ only allows the usage of a bacpac with SQL express variant?

Likely because that functionality was never prioritized:-(


CLI argument--terragrunt-include-dir includes all folders if the pattern does not match since version 0.50.1

Describe the bug
A run of terragrunt run-all apply --terragrunt-include-dir "does-not-exist-*" leads to apply of all folders in the current directory. Especially dangerous when running in the CI and you upgraded from 0.50.0 to any later version!
The weird behaviour of this was introduced with this PR: https://github.com/gruntwork-io/terragrunt/pull/2664
IMO this is a breaking change but was added as a patch increment.
Steps To Reproduce

Create a folder with multiple subfolders that contain terragrunt.hcl files.
Head to the folder and execute the above mentioned command, make sure the include pattern you specify does not match.
You should see that it selects all folders for the execution plan.

I confirmed in my local tests that it is not related to glob matching, so any non existing folder in the include should work to reproduce the problem.
Expected behavior

After executing the above command and no folder is matching the specified include pattern, I expect an empty execution and nothing to happen.
The argument --terragrunt-include-dir should work like a whitelist (which it did before version 0.50.1)

Nice to haves
A screenshot of a CLI session to reproduce:

Versions

Terragrunt version: 0.50.0

That definitely is a bug! We'll look to get it fixed!

Resolved in v0.63.4.


Add data.json to extra static files

This commit brings the existing data.json file (currently served at https://www.consumerfinance.gov/data.json) into this repository. It currently lives in an internal private repo which is being deprecated.
This file will be served from the site root using an Apache alias to be configured elsewhere. We want it to live alongside other site root files like code.json and robots.txt.
To simplify how this works currently, I've altered the gulp:copy task and created a new "extra" folder under cfgov/unprocessed to contain the miscellaneous files that we currently serve from the site root but don't fit into other categories (like images, css, etc):

BingSiteAuth.xml - Bing domain verification file
code.json - existing code.gov inventory file
data.json - existing data.gov inventory file
favicon.ico - website favicon
lln8595c61g9qnvuwvtlcwo1k6kem8.html - FB domain verification file
robots.txt - robots.txt

The regular gulp build task will now copy each of these files to cfgov/static_built, where they get served by Django under /static. Apache then handles aliases for each of these files so they get served from the site root.
I'm open to better ideas that "extra" for this folder. I also considered "extra-static", "extrastatic", "root". Any other ideas/suggestions?
Testing
Run yarn run gulp build and confirm that files are properly copied. Then run your local server and confirm that these links all work as expected:

http://localhost:8000/static/BingSiteAuth.xml
http://localhost:8000/static/code.json
http://localhost:8000/static/data.json
http://localhost:8000/static/favicon.ico
http://localhost:8000/static/lln8595c61g9qnvuwvtlcwo1k6kem8.html
http://localhost:8000/static/robots.txt

Checklist

[X] PR has an informative and human-readable title
[X] Changes are limited to a single goal (no scope creep)
[X] Code can be automatically merged (no conflicts)
[X] Code follows the standards laid out in the CFPB development guidelines
[X] Passes all existing automated tests
[ ] Any change in functionality is tested
[ ] New functions are documented (with a description, list of inputs, and expected output)
[ ] Placeholder code is flagged / future todos are captured in comments
[X] Visually tested in supported browsers and devices (see checklist below :point_down:)
[ ] Project documentation has been updated
[X] Reviewers requested with the Reviewers tool :arrow_right:

Thanks all for the reviews. I've renamed the directory to "root" as @Scotchester suggests.


Carousels do not work well with each other.

When using carousel more than one, they do not display well.
demo on jsfiddle

I'm sorry if this sounds rude, but why would you want to have 2 carousels on the same page? This seems like a nightmare for both the user (too many foci of attention) and for accessibility.

@yahtnif Thank you. I am looking into it.
@tomcam For example, the carousel sliders for two or more products in one post.

@yahtnif Spectre supports multiple carousels in one page. Make sure using different name for inputs for different carousels.

@picturepan2 Thanks


Expecting form-data encoding, but got normal encoding in Certificate Manager 1.7

After installing Certificate Manager 1.7 and when browsing to the PKI Certificate and Key Management screen under System, I get the following error message when clicking on "Import Certificate":
Error
Expecting form-data encoding, but got normal encoding
I switched to the old Webmin theme and the import worked as expected.
I cleared the theme cache and checked for anything which could be obvious, including searching related issues and doing a bit of googling on the web, but could not find anything specific to this issue.
Thanks,
Zuhair

Zuhair, hi.
This module is almost 10 years old and has issues. It needs to be fixed to work with single-page applications.


Add remaining Comonad* instances

It's not clear to me what the remaining instances here are.

Looks like ComonadAsk and ComonadTraced instances are still missing for Store, Env and Traced.

Ah, gotcha. Thanks!


[Windows] New files are not being detected by editor

Tested versions
Reproducible in
v4.4.dev1.mono.official [28a72fa43]
v4.4.dev.custom_build [da230f384b90360ec108ce1be2347a327d68ca07]
v4.4.dev.custom_build [ce8a837aa]
Not Reproducible in:
v4.3.stable.mono.official [77dcf97d8]
System information
Godot v4.4.dev1.mono - Windows 10.0.22631 - Intel(R) Core(TM) i9-14900K (32 Threads)
Issue description
New files are not being detected by the editor when created outside of the editor (via file explorer, saving from blender etc)
Steps to reproduce

Open project in editor.
Switch to file explorer
Duplicate icon.svg using file explorer.
Switch back to editor
Notice icon.svg - Copy is not detected/imported.

Shutting down the editor and re-opening it detects the new icon.svg copy
Minimal reproduction project (MRP)
default project

I also observed this problem when migrating my project to 4.3


Is there any way to switch Video Player to Audio Player without reloading the manifest

Have you read the Tutorials?
Yes
Have you read the FAQ and checked for duplicate open issues?
Yes
What version of Shaka Player are you using?
4.3.5
Please ask your question
Hi Team,
Is there any way to switch Video Player to Audio Player without reloading the manifest?
Currently I am setting
playerConfig.manifest.disableVideo = false;
and calling player.load for switch from audio to video
player.load(mainurl,startTime).then(()=>{
console.log('manifest loaded');
}).catch(()=>{
console.log('error');
});
})

Duplicate of https://github.com/shaka-project/shaka-player/issues/5237


Prefer dark theme per OS setting

https://github.com/Dansoftowner/jSystemThemeDetector
https://bugs.openjdk.java.net/browse/JDK-8235460
Probably not worth caring about.

I have minimal knowledge of kotlin and swing (I learned JavaFX in school, go figure) but I got this working on startup, just didn't add a listener. If this is ample I'll create a pull request.

Yeah, if you want to throw a PR up, I'd be happy to take a look. I think one-time detection would be fine.